(19) 



J 



Europaisches Patentamt 
European Patent Office 
Office ur peen des brevets 



(12) 



(43) Date of publication: 

13.11.2002 Bulletin 2002/46 

(21) Application number: 02010071.5 

(22) Date of filing: 06.05.2002 



(H) EP 1 256 310 A2 

EUROPEAN PATENT APPLICATION 

(51) Intci7: A61 B 1/045, A61 B 1/04 



(84) Designated Contracting States: 


(71) Applicant: Fuji Photo Film Co., Ltd. 


AT BE CH CY DE DK ES Fl FR GB GR IE IT LI LU 


Kanagawa-ken (JP) 


MC NL PT SE TR 




Designated Extension States: 


(72) Inventor: Tomonari, Sendai, 


AL LT LV MK RO SI 


c/oFuji Photo Film Co., Ltd. 




Ashigarakami-gun, Kanagawa-ken (JP) 


(30) Priority: 07.05.2001 JP 2001136046 




27.03.2002 JP 2002089108 


(74) Representative: Klunker . Schmitt-Nilson . Hirsch 




Winzererstrasse 106 




80797 Mtinchen (DE) 



(54) Fluorescence image display apparatus 

(57) A fluorescence image display apparatus is pro- 
vided; wherein, when a pseudo color image represent- 
ing the tissue state of a target subject is obtained, based 
on a fluorescence image emitted from the target subject 
upon the irradiation thereof by an excitation light, the 
tissue state can be recognized regardless of the inten- 
sity of the fluorescent light. Based upon the statistical 
quantity of a wide band fluorescence image computed 
by a statistical quantity computing means, a gain that 
the wide band and narrow band fluorescence image da- 



ta are to be multiplied by is computed by a gain comput- 
ing means. A gain multiplying means multiplies the wide 
band and narrow band fluorescence image data by the 
gain, whereby a green gradation is assigned to the wide 
band fluorescence image and a red gradation is as- 
signed to the narrow band fluorescence image, and a 
composite image data is obtained by an image compos- 
ing means. 
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Description 

BACKGROUND OF THE INVENTION 
Field of the Invention 

[0001] The present invention relates in general to a fluorescence image display apparatus, and in particular to a 
fluorescence image display apparatus for measuring the fluorescent light emitted from a target subject upon the irra- 
diation thereof by an excitation light and displaying as an image the data relating to said target subject. 

Description of the Related Art 



[0002] Fluorescent light detection apparatuses have been proposed that make use of the fact that the intensity of 
the fluorescent light emitted from a normal tissue differs from the intensity of the fluorescent light emitted from a diseased 
is tissue when a target subject (i.e., a living tissue) is irradiated by an excitation light within an excitation wavelength 
range of the intrinsic fluorophores of the target subject, wherein, by detecting the fluorescent light emitted from a target 
subject upon irradiation thereof by an excitation light within a predetermined wavelength range, the location and range 
of penetration of a diseased tissue is discerned. 

[0003] Normally, when a target subject is irradiated by an excitation light, because a high-intensity fluorescent light 

20 is emitted from a normal tissue, as shown by the solid line in Fig. 26, and a weak-intensity fluorescent light is emitted 
from a diseased tissue, as shown by the broken line in Fig. 26 : by measuring the intensity of the fluorescent light emitted 
from the target subject, it can be determined whether the target subject is in a normal or a diseased state. These types 
of fluorescence image display apparatuses are in many cases provided built in to the configuration of an endoscope 
for insertion into a body cavity of a patient, a colposcopy or a surgical microscope. 

25 [0004] However, for cases in which the intensity of the fluorescent light emitted from a target subject upon the irra- 
diation thereof by the excitation light is to be displayed as an image, because there is unevenness on the surface of 
a target subject, the intensity of the excitation light irradiating the target subject is not of a uniform intensity. Further, 
although the intensity of the fluorescent-light emitted from the target subject is substantially proportional to the intensity 
of the excitation light, the intensity of the aforementioned excitation light becomes weaker in inverse proportion to the 

30 square of the distance between the excitation light and the target subject. Therefore, there are cases in which the 
fluorescent-light received from a diseased tissue located at a position closer to the excitation light source than a normal 
tissue is of a higher intensity than the fluorescent-light received from aforementioned normal tissue, and the state of 
the tissue of the target subject cannot be accurately discerned based solely on the data relating to the intensity of the 
fluorescent-light received from the target subject upon the irradiation thereof with an excitation light. 

35 [0005] In order to remedy the problems described above, methods such as that described in the specification of US 
Patent No. 5647368, wherein by colorizing and synthesizing a fluorescence image obtained by irradiating a target 
subject with an excitation light having a wavelength in the wavelength range near 500 nm, upon which the intensity of 
the fluorescent light emitted from the target subject changes by a large degree depending on the tissue state of the 
target subject, with a fluorescence image obtained by irradiating the target subject with an excitation light having a 

40 frequency in the wavelength range near 630 nm, upon which the intensity of the fluorescent light emitted from the 
target subject exhibits no change depending on the tissue state of the target subject, to obtain a colorized synthesized 
image; when said colorized synthesized image is displayed, the tissue state of the target subject can be accurately 
discerned based on the visually recognizable color thereof, have been proposed. 

[0006] Further, there has been proposed, as described in Japanese Unexamined Patent Publication No. 

45 2001-157658, a method of colorizing and displaying two types of fluorescence images based on the irradiation of a 
target subject with two different wavelengths of excitation light (a narrow band excitation light having a wavelength 
near 480 nm, and a wide band excitation light having a wavelength within the wide band of 430-730 nm) . According 
to this method, because the band of the fluorescent light is wider in comparison to the method proposed in the afore- 
mentioned US Patent No. 5647368 . the S/N ratio of the images obtained by additive color mixture can be improved, 

50 and because the intensity of the fluorescence images changes by a large amount in accordance with the tissue state 
of the target subject for both bands, the color change corresponding to the change in the tissue state can be made 
more distinct, whereby the distinguishability of the tissue state is improved a level. 

[0007] However, according to the above described methods of displaying colorized synthesized images, the color 
of the image to be displayed is regulated by a chromaticity, which is determined in correspondence to the of the ratio 
55 of the two types of fluorescence images that are to be color added and mixed, and a luminosity, which is determined 
in correspondence to the intensity of the fluorescence images. Because the chromaticity of the image to be displayed 
is determined in correspondence to the ratio of the two types of fluorescence images that are to be color added and 
mixed, the chromaticity of the image that is to be displayed, which corresponds to the tissue state of the target subject, 



JNSDOCID: <EP 1 25631 0A2J_> 



2 



EP 1 256 310 A2 

can be determined at once. However, because the fluorescent light intensity differs according to the distance between 
the light source and the target subject, the luminosity of the image to be colorized differs according to the aforemen- 
tioned distance. Here, these types of fluorescence image display apparatuses are in many cases provided in the con- 
figuration of an endoscope for insertion into a body cavity of a patient, a colposcope, or a surgical microscope; because 

5 the objective of the use thereof is the measurement of an internal portion of a body cavity, the distance between the 
target subject and any of said apparatuses is between several to 50 mm. Therefore, if the distance between the distal 
end of the insertion portion that is inserted into the body cavity of a patient and the target subject changes, the intensity 
of the fluorescent light changes; as a result, the luminosity of the synthesized image changes. If the luminosity of the 
colorized synthesized image changes in this manner, because the color appearing in the displayed color added and 

10 mixed image will be recognized as a different color even if the chromaticity thereof is the same, there is a fear that 
even though tissues have the same tissue state, said tissues will be discerned to have different tissue states. On the 
other hand, for cases- in which the luminosity of the image to be colorized is low; there are cases in which even though 
a chromaticity is different, the color in the displayed colorized synthesized image cannot be recognized to be different, 
giving rise to a fear that a diseased portion might be overlooked. 

15 

SUMMARY OF THE INVENTION 

[0008] The present invention has been developed in consideration of the forgoing circumstances, and it is an object 
of the present invention to provide a fluorescence image display apparatus capable of displaying a fluorescence image 
20 wherein it is possible to accurately discern, regardless of the intensity of the fluorescent light, the tissue state of the 
target subject depicted therein. 

[0009] The first fluorescence image display apparatus according to the present invention comprises a fluorescence 
image obtaining means for irradiating a target subject with an excitation light and obtaining two fluorescence image 
data, each formed of fluorescent light of a mutually different wavelength band, based on the fluorescent light intensity 
25 emitted from the target subject upon the irradiation thereof by the excitation light, 

a gain computing means for computing, based on the statistical quantity of either one of said two fluorescence 
image data, a gain that said two fluorescence image data are to be multiplied by, 

a multiplying means for multiplying said two fluorescence image data by said gain and obtaining two multiplied 
30 fluorescence image data, an image forming means for forming, based on said two multiplied fluorescence image 

data, a pseudo color image data representing a pseudo color image reflecting the tissue state of the target subject, 
and an image display means for displaying said pseudo color image. 

[0010] Here : the expression "based on the statistical quantity of either one of said two fluorescence image data, a 
35 gain that said two fluorescence image data are to be multiplied by" refers to, for example: in a case in which the 
statistical quantity of the fluorescence image data is smaller than a desired value, that is, when the size of the data 
value of the fluorescence image data is not large enough, the a gain is computed so that the data value of the multiplied 
fluorescence image data becomes a larger value than that of the fluorescence image data, whereby the statistical 
quantity of the multiplied fluorescence image data becomes greater than or equal to the aforementioned desired value; 
40 for a case in which the statistical quantity of the fluorescence image data is larger than a desired value, that is, when 
the size of the data value of the fluorescence image data is too large, a gain is computed so that the data value of the 
multiplied fluorescence image data becomes a smaller value than that of the fluorescence image data, whereby the 
statistical quantity of the multiplied fluorescence image data becomes less than or equal to the aforementioned desired 
value; and, for a case in which the statistical quantity of the fluorescence image data is substantially equivalent to a 
45 desired value, that is, when the size of the data value of the fluorescence image data is adequately large, a gain is 
computed so that the data value of the multiplied fluorescence image data becomes substantially equivalent to that of 
the fluorescence image data. 

[0011] More specifically, the gain can be computed by use of the following formulas (1) or (2). That is to say, if the 
dynamic range of the display means is designated as DR (e.g., 255 in the case of data formed of eight bits), the largest 
50 value of the fluorescence image data as Max, the smallest value of the fluorescence image data as Min, and two 
arbitrary constants a (0.9-0.95), and b (e.g., 2) are designated: 

Gain upper limit = DR x al {(Max + Min)/2 + b x (Max - 
55 Min)/2} (1) 

[001 2] Further, if the dynamic range of the display means is designated as DR, the average value of the fluorescence. 
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image data as m, the standard deviation as a, and two arbitrary constants a and b are designated: 

Gain lower limit = DR x a/ (m + b x o) (2) 

5 

[001 3] Note that if the gains that the two fluorescence image data are to be multiplied by have a constant relationship 
(e.g., making the gain that one of the two fluorescence image data is multiplied by C times that which the other of the 
two fluorescence image data is multiplied by {where C is a constant} etc.) the gains can be of different values. 
[0014] Note that according to the first fluorescence image display apparatus of the present invention, the image 
10 forming means can also be a means for forming the pseudo color image, based on the additive color mixture method, 
from both of the multiplied fluorescence image data. 

[0015] Further, according to<h3trt^tfkrorescence^mage display apparatus of the present invention -the image forming- 
means can be a means comprising: a color image forming means for forming a color added and mixed image data, 
based on the additive color mixture method, from both of the multiplied fluorescence image data, and a color image 
15 data, based on said color added and mixed image data, representing the chromatic components of the color added 
and mixed image represented by said data, 

a luminosity image forming means for forming a luminosity image data representing a luminosity image by assigning 
a luminosity display gradation to the pixel values of the multiplied fluorescence image represented by either of the 
20 two multiplied fluorescence image data, 

and a composite image forming means for combining the color image data and the luminosity image data to form 
a composite image. 

[0016] The referents of "chromatic components" include all of the following: the hue of the color added and mixed 
25 image; the color saturation, or the color saturation and the hue; the X,Y components of an XYZ color space; the ab 
components of a Lab color space; the uv components of a Luv color space; the a*b* components of a uniform La*b* 
color space; the u*v* components of a uniform Lu*v* color space; etc. 

[0017] The expression "assigning a luminosity display gradation to the pixel values of the multiplied fluorescence 
image represented by either of the two multiplied fluorescence image data" refers to the assignment of a numerical 
30 value representing a degree of brightness to each pixel value of the multiplied fluorescence image, corresponding to 
the size of each said pixel value; 

[0018] Further, the image forming means can be a means comprising: a color image forming means for forming a 
color added and mixed image data, based on the additive color mixture method, from both of the multiplied fluorescence 
image data, and a color image data, based on said color added and mixed image data, representing the chromatic 
35 components of the color added and mixed image represented by said color added and mixed image data, 

a luminosity image forming means for forming a luminosity image data representing a luminosity image by assigning 
a luminosity display gradation to the pixel values of the fluorescence image represented by either of the two fluo- 
rescence image data, 

40 and a composite image forming means for combining the color image data and the luminosity image data to form 

a composite image. 

[0019] Further, the first fluorescence image display apparatus according to the present invention can further comprise 
a dynamic range expanding means for expanding, based on the statistical quantity, the dynamic range of both of the 
45 multiplied fluorescence image data so that the dynamic range thereof spans substantially the entirety of the dynamic 
range of the display region of display means. 

[0020] In this case, it is preferable that a switching means for switching between a drive mode and a non-drive mode 
of the dynamic range expanding means be further provided. 

[0021] Further, according to the first fluorescence image display apparatus of the present invention, the gain com- 
so puting means can be a means for computing the gain based on the statistical quantity of a desired region of the fluo- 
rescence image represented by either of the fluorescence image data. 

[0022] Here : the referent of "a desired region" is, for example, an image region of an obtained fluorescence image 
that is an area with a high level of interest. 

[0023] Further, according to the first fluorescence image display apparatus of the present invention, it is preferable 
55 that the statistical quantity be formed of at least one of the following: the maximum value of the fluorescence image 
data, the minimum value of the fluorescence image data : the average value of the fluorescence image data, a value 
combining the maximum value of the fluorescence image data and the standard deviation, a value combining the 
maximum and minimum values of the fluorescence image data, a value combining the minimum value of the fluores- 
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cence image data and the standard deviation, and a value combining the average value of the fluorescence image 
data and the standard deviation. 

[0024] The second fluorescence image display apparatus according to the present invention comprises: a fluores- 
cence image obtaining means for irradiating a target subject with an excitation light and obtaining two fluorescence 
5 image data, each formed of fluorescent light of a mutually different wavelength band, based on the fluorescent light 
intensity emitted from the target subject upon the irradiation thereof by the excitation light, 

a reflectance image obtaining means for irradiating a target subject with a reference light and obtaining a reflectance 
image data, based on the intensity of the reference light reflected from the target subject upon the irradiation thereof 
10 by the reference light, 

a gain computing means for computing, based on the statistical quantity of said reflectance image data, a gain 
that said- two fluorescence image*data are to be multiplied by, 

a multiplying means for multiplying said two fluorescence image data by said gain and obtaining two multiplied 
fluorescence image data, 

15 an image forming means for forming, based on said two multiplied fluorescence image data, a pseudo color image 

data representing a pseudo color image reflecting the tissue state of the target subject, and 
an image display means for displaying said pseudo color image. 

[0025] Nole that according to the second fluorescence image display apparatus of the present invention, the image 
20 forming means can also be a means for forming the pseudo color image, based on the additive color mixture method, 
from both of the multiplied fluorescence image data. 

[0026] Further, according to the second fluorescence image display apparatus of the present invention, the image 
forming means can be a means comprising: a color image forming means for forming a color added and mixed image 
data, based on the additive color mixture method, from both of the multiplied fluorescence image data, and a color 
25 image data, based on said color added and mixed image data, representing the chromatic components of the color 
added and mixed image represented by said color added and mixed image data, 

a luminosity image forming means for obtaining a multiplied reflectance image data by multiplying the reflectance 
image data by said gain, and forming a luminosity image data representing a luminosity image by assigning a 
30 luminosity display gradation to the pixel values of the multiplied reflectance image or the pixel values of the mul- 

tiplied fluorescence image represented by either of the two multiplied fluorescence image data, and 
a composite image forming means for combining the color image data and the luminosity image data to form a 
composite image. 

35 [0027] In this case, it is preferable that it be possible to switch the image to which the luminosity display gradation 
is to be assigned between the multiplied reflectance image and either of the two multiplied fluorescence images. 
[0028] It is preferable that a light that is not readily absorbable by the target subject, such as near-infrared light or 
the like be used as the reference light. 

[0029] Further, the image forming means can be a means comprising: a color image forming means for forming a 
40 color added and mixed image data, based on the additive color mixture method, from both of the multiplied fluorescence 
image data, and a color image data, based on said color added and mixed image data, representing the chromatic 
components of the color added and mixed image represented by said color added and mixed image data, 

a luminosity image for forming means forming a luminosity image data representing a luminosity image by assigning 
45 a luminosity display gradation to the pixel values of the reflectance image or the pixel values of the fluorescence 

image represented by either of the two fluorescence image data, and 

a composite image forming means for combining the color image data and the luminosity image data to form a 
composite image. 

so [0030] In this case also, it is preferable that it be possible to switch the image to which the luminosity display gradation 
is to be assigned between the multiplied reflectance image and either of the two multiplied fluorescence images. 
[0031] The third fluorescence image display apparatus according to the present invention comprises: a fluorescence 
image obtaining means for irradiating a target subject with an excitation light and obtaining two fluorescence image 
data, each formed of fluorescent light of a mutually different wavelength band, based on the fluorescent light intensity 

55 emitted from the target subject upon the irradiation thereof by the excitation light, 

a reflectance image obtaining means for irradiating a target subject with a reference light and obtaining a reflectance 
image data, based on the intensity of the reference light reflected from the target subject upon the irradiation thereof 
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by the reference light, 

a gain computing means for computing, based on the statistical quantity of said reflectance image data, a gain 
that said two fluorescence image data are to be multiplied by ; 

a multiplying means for multiplying said two fluorescence image data by said gain and the reflectance image data 
5 to obtain two multiplied fluorescence image data and a multiplied reflectance data, 

a difference computing means for computing the difference data between the multiplied reflectance image data 
and either of the two multiplied fluorescence image data, 

an image forming means for forming, based on said difference data and the other multiplied fluorescence image 
data of the aforementioned two multiplied fluorescence image data, a pseudo color image data representing a 
10 pseudo color image reflecting the tissue state of the target subject, and 

an image display means for displaying said pseudo color image. 

[0032] Note that according to the third fluorescence image display apparatus of the present invention, the image 
forming means can also be a means for forming the pseudo color image, based on the additive color mixture method, 

'5 from both of the multiplied fluorescence image data. 

[0033] Further, according to the third fluorescence image display apparatus of the present invention, the image form- 
ing means can be a means comprising: a color image forming means for forming a color added and mixed image data, 
based on the additive color mixture method, from the difference data and the multiplied fluorescence image data, and 
a color image data, based on said color added and mixed image data, representing the chromatic components of the 

20 color added and mixed image represented by said color added and mixed image data, 

a luminosity image forming means for assigning a luminosity display gradation to the pixel values of the multiplied 
reflectance image represented by the multiplied reflectance image data or the pixel values of the multiplied fluo- 
rescence image represented by either of the two multiplied fluorescence image data to form a luminosity image 
25 data representing a luminosity image, and 

a composite image forming means for combining the color image data and the luminosity image data to form a 
composite image. 

[0034] In this case, it is preferable that it be possible to switch the image to which the luminosity display gradation 
30 is to be assigned between the multiplied reflectance image and either of the two multiplied fluorescence images. 

[0035] Further, according to the third fluorescence image display apparatus of the present invention, the image form- 
ing means can be a means comprising: a color image forming means for forming a color added and mixed image data, 
based on the additive color mixture method, from both of the multiplied fluorescence image data, and a color image 
data, based on said color added and mixed image data, representing the chromatic components of the color added 
35 and mixed image represented by said color added and mixed image data, 

a luminosity image forming means for assigning a luminosity display gradation to the pixel values of the reflectance 
image represented by the multiplied refleptance image data or the pixel values of the fluorescence image repre- 
sented by either of the two fluorescence image data to form a luminosity image data representing a luminosity 
40 image, and 

a composite image forming means for combining the color image data and the luminosity image data to form a 
composite image. 

[0036] In this case also, it is preferable that it be possible to switch the image to which the luminosity display gradation 
45 is to be assigned between the multiplied reflectance image and either of the two multiplied fluorescence images. 

[0037] Further, the second and third fluorescence image display apparatuses according to the present invention may 
further comprise a dynamic range expanding means for expanding, based on the statistical quantity, the dynamic range 
of the reflectance image data and/or both of the multiplied fluorescence image data so that the dynamic range thereof 
spans substantially the entirety of the display means. 
so [0038] In this case, it is preferable that a switching means for switching between a drive mode and a non-drive mode 
of the dynamic range expanding means be further provided. 

[0039] Further, according to the second and third fluorescence image display apparatuses of the present invention, 
the gain computing means can be a means for computing the gain based on the statistical quantity of a desired region 
of the reflectance image represented by the reflectance image data. 
55 [0040] Further, according to the second and third fluorescence image display apparatuses of the present invention, 
it is preferable that the statistical quantity be formed of at least one of the following: the maximum value of the fluores- 
cence image data, the minimum value of the fluorescence image data, the average value of the fluorescence image 
data, a value combining the maximum value of the fluorescence image data and the standard deviation, a value com- 
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bining the maximum and minimum values of the fluorescence image data, a value combining the minimum value of 
the fluorescence image data and the standard deviation, and a value combining the average value of the fluorescence 
image data and the standard deviation. 

[0041] Note that according to the first through third fluorescence image display apparatuses of the present invention: 
5 the image forming means can be a means for obtaining a reverse fluorescence image data by inverting the light intensity 
of either of the multiplied fluorescence image data; and forming a pseudo color image, based on this reverse fluores- 
cence image data and the other multiplied fluorescence image data of the aforementioned two multiplied fluorescence 
image data. 

[0042] The expression "obtaining a reverse fluorescence image data by inverting the light intensity of either of the 
10 multiplied fluorescence image data" refers to the subtraction of the pixel value of each pixel of the multiplied fluores- 
cence image represented by a multiplied fluorescence image data from the largest obtainable value of the multiplied 
fluorescence-image data (e.g.; if the data consists of 8bits, 255), or the computation of the reciprocal value of the pixel 
value of each pixel. 

[0043] Further, according to the first through third fluorescence image display apparatuses of the present invention: 
15 the image forming means can be a means for obtaining a reverse fluorescence image data by inverting the light intensity 
of either of the multiplied fluorescence image data; multiplying the reverse fluorescence image data by a predetermined 
constant to obtain a constant-multiplied reverse fluorescence image data and forming the pseudo color image based 
on this constant-multiplied reverse fluorescence image data and the other multiplied fluorescence image data of the 
aforementioned two multiplied fluorescence image data. 
20 [0044] A value less than 1 can be used as the constant. 

[0045] Note that according to the first through third fluorescence image display apparatuses of the present invention: 
for cases in which the fluorescence image data or the reflectance image data is represented by data constituted of 9 
bits or more, a bit shifting means can be provided for shifting the bits of the fluorescence image data or the reflectance 
image data so that said data is expressed by the lower 8 bits thereof, and the statistical quantity computing means can 
25 be a means for computing the statistical quantity based on the bit-shifted data; and the gain computing means can be 
a means for computing the gain based on the statistical quantity of the bit shifted data value. 

[0046] Here : the expression "shifting the bits of the fluorescence image data or the reflectance image data so that 
said data is expressed by the lower 8 bits thereof" refers to the rounding off of the bit data in the case that the fluores- 
cence image data is expressed by 9 or more bits so as to obtain a data value of less than 8 bits; 8-bit data can be 

30 computed by use of a common calculator. 

[0047] Further, a portion or the entirety of the fluorescence image obtaining means of the first fluorescence image 
display apparatus or of the fluorescence image obtaining means and reflectance image obtaining means of the second 
and third fluorescence image obtaining apparatuses according to the present invention can be provided in the form of 
an endoscope provided with an insertion portion to be inserted into a body cavity of a patient. 

35 [0048] Here : the expression "provided in the form of an endoscope" refers to the disposal of a portion or the entirety 
of the fluorescence image obtaining means and the reflectance image obtaining means within the interior portion of 
an endoscope system. Further, the referents of "a portion" include the light emitting end for emitting the excitation light 
and the reference light, and the light receiving end for receiving the fluorescent light emitted from the target subject 
upon the irradiation thereof by the excitation light and the reference light reflected from the target subject upon the 

40 irradiation thereof by the reference light. 

[0049] Further, the excitation light source may be a GaN type semiconductor laser, and the wavelength band thereof 
can be in the 400-420 nm range. 

[0050] Note that the first through third fluorescence image display apparatuses according to the present invention 
may also be provided as apparatuses combining the additional function of obtaining and displaying a standard image, 

45 based on the light reflected from the target subject upon the irradiation thereof by a white light. 

[0051] According to the first fluorescence image display apparatus of the present invention: a gain that two fluores- 
cence image data are to be multiplied by is computed based on the statistical quantity of either of two fluorescence 
image data; two multiplied fluorescence image data are obtained by multiplying both of the fluorescence image data 
by this gain; and a pseudo color image data representing a pseudo color image reflecting the tissue state of the target 

so subject is obtained based on both of the multiplied fluorescence image data. Therefore, because a pseudo color image 
can be obtained from a multiplied fluorescence image data having a desired data value, the pseudo color image can 
be formed so as to have a desired luminosity, regardless of the intensity of the fluorescent light. That is to say, the 
luminosity of the fluorescence image, which is an effect of the intensity of the fluorescenrlight; can be adjusted so as 
to be within a desired luminosity range, whereby the distinguishability of the tissue state of the target subject can be 

55 improved. 

[0052] According to the second fluorescence image display apparatus of the present invention: a gain that two flu- 
orescence image data are to be multiplied by is computed based on the statistical quantity of the reflectance image 
data representing a reflectance image formed of the light reflected from a target subject upon the irradiation thereof 
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by a reference light; two multiplied fluorescence image data are obtained by multiplying both of the fluorescence image 
data by this gain; and a pseudo color image data representing a pseudo color image reflecting the tissue state of the 
target subject is obtained based on both of the multiplied fluorescence image data. Therefore, because a pseudo color 
image can be obtained from a multiplied fluorescence image data having a desired data value, the pseudo color image 

5 can be formed so as to have a desired luminosity, regardless of the intensity of the fluorescent light. That is to say, the 
luminosity of the fluorescence image, which is an effect of the intensity of the fluorescent light : can be adjusted so as 
to be within a desired range, whereby the distinguishability of the tissue state of the target subject can be improved. 
Further, because the intensity of said reflectance image is higher than that of the fluorescence image, the computation 
of the gain, which is performed based on the statistical quantity, can be performed more adequately. 

io [0053] According to the third fluorescence image display apparatus of the present invention: a gain that two fluores- 
cence image data are to be multiplied by is computed based on the statistical quantity of the reflectance image data 
representing a reflectance image- formed of the light reflected from a target- subject upon the irradiation thereof- by a 
reference light; a multiplied reflectance image data and two multiplied fluorescence image data are obtained, respec- 
tively, by multiplying the reflectance image data and both of the fluorescence image data by this gain; the difference 

is data between the multiplied reflectance image and either of the two multiplied fluorescence images is computed; and 
a pseudo color image data representing a pseudo color image reflecting the tissue state of the target subject is obtained 
based on the difference data and the other multiplied fluorescence image data of the aforementioned two multiplied 
fluorescence image data. Therefore, because a pseudo color image can be obtained from a multiplied fluorescence 
image data having a predetermined data value, the pseudo color image can be formed so as to have a desired lumi- 

20 nosity, regardless of the intensity of the fluorescent light. Further, by computing the difference data between the mul- 
tiplied reflectance image and the multiplied fluorescence image, the difference between the diseased tissue and the 
normal tissue can be more clearly rendered. That is to say, by adjusting the luminosity of the fluorescence image, which 
is an effect of the intensity of the fluorescent light, to within a desired luminosity range, the distinguishability of the 
tissue state of the target subject can be improved. 

25 [0054] Further, by forming, based on the additive color mixture method, a pseudo color image data from both of the 
multiplied fluorescence image data, the tissue state of the target subject can be accurately discerned based on the 
visually recognized color. 

[0055] Still further: by forming, based on the additive color mixture method, a pseudo color image data from both of 
the multiplied fluorescence image data, and a color image data, based on said color added and mixed image data, 

30 representing the chromatic components of the color added and mixed image represented by said color added and 
mixed image data; assigning a luminosity display gradation to the pixel values of the multiplied reflectance image or 
the pixel values of either of the two multiplied fluorescence images to form a luminosity image data; and combining 
the color image data and the luminosity image data to form a composite image; the hue of the displayed pseudo color 
image becomes a hue reflecting the tissue state of the target subject; the luminosity reflects the light intensity for cases 

35 in which the multiplied reflectance image has been employed to form the luminosity image data, that is, the form of the 
target subject; and for cases in which the one of the multiplied fluorescence image has been employed to form the 
luminosity image data, the luminosity reflects the tissue state of the target subject in addition to the form thereof. 
Accordingly, data relating to the tissue state otthe target subject as well as data relating to the form of the target subject 
can be displayed concurrently in a single image. In particular, for cases in which the luminosity image data has been 

40 formed from one of the multiplied fluorescence images, even for cases in which the distance between the target subject 
and the light emitting end of the excitation light source is comparatively small, if there is a diseased portion present in 
said target subject, because the luminosity thereof is reduced, the luminosity contrast can be added to the chromaticity 
contrast in the pseudo color image. 

[0056] Note that for cases in which a luminosity display gradation is assigned to the multiplied reflectance image or 
45 either of the two multiplied fluorescence images, because the gain changes by a large amount if the distance between 
the target subject and the image obtaining means changes a large amount, the brightness of the displayed pseudo 
color image also changes by a corresponding large amount. Therefore, by assigning a luminosity display gradation to 
the reflectance image or either of the two fluorescence images prior to the multiplication of the gain therewith, a large 
change in the brightness of the pseudo color image can be prevented. 
so [0057] Further, by expanding the dynamic range of the multiplied reflectance image data and/or the dynamic range 
of both of the multiplied fluorescence image data, so that the dynamic range of the multiplied reflectance image data 
and/or the dynamic range of both of the multiplied fluorescence image data spans substantially the entire dynamic 
range of the display means, because the contrast of the multiplied reflectance image or the multiplied fluorescence 
image can be expanded, the change in the tissue state of the target subject appearing in the pseudo color image can 
55 be represented in detail, whereby the distinguishability of the tissue state of the target subject can be improved. 

[0058] Note that in this case, by switching, by use of a switching means, the dynamic range expanding means be- 
tween a drive mode and a non-drive mode, because the dynamic range expansion process can be set so as to not be 
performed in cases in which said process is not required, a pseudo color image reflecting the preferences of the operator 



JNSOOCID: <EP 1 25631 0A2J_> 



EP 1 256 310 A2 

can be displayed. 

[0059] Further, by making the statistical quantity consist of at least one of the following elements of the fluorescence 
image data or the reflectance image data: the maximum value, the minimum value, the average value, a value com- 
bining the maximum value and the standard deviation, a value combining the maximum and minimum values, a value 
5 combining the minimum value and the standard deviation, and a value combining the average value and the standard 
deviation; the computation of the statistical quantity can be performed comparatively easily. 

[0060] Still further, if the gain computing means is a means for computing the gain based on the statistical quantity 
of the fluorescence image data or the reflectance image data within a desired portion of the fluorescence image data 
or the reflectance image data, the amount of computation required for computing the statistical quantity can be reduced. 

10 [0061] In addition, although the change in the intensity of the fluorescent light emitted from a diseased portion is in- 
phase in both multiplied fluorescence image data, by obtaining a reverse fluorescent image data by inverting the in- 
tensity of either of the two multiplied fluorescence image data, the change in intensity between the reverse fluorescence 
image data and the other of the two multiplied fluorescence image data, can be made to be antiphase. Accordingly, 
the change between the hue of the diseased portion and the hue of the normal portion appearing in the pseudo color 

'5 image can be enlarged, whereby the distinguishability of the tissue state of the target subject can be improved a level. 
[0062] Note that for cases in which the intensity has been inverted, there are cases in which the dark portions other 
that the diseased portion included in the pseudo color image become the same color as the diseased portion. Therefor, 
by multiplying the multiplied fluorescent image of which the intensity has been inverted by a constant, the effect whereby 
the dark portions appearing in the pseudo color image become the same color as the diseased portion can be sup- 

20 pressed, whereby the misrecognition of the diseased portion and the portions that are simply dark portions can be 
prevented, and the distinguishability of the tissue state of the target subject can be improved a level. 
[0063] Further, in the case that a bit shifting means is provided for shifting the bits of the reflectance image data or 
the fluorescence image data for cases in which the fluorescence image data or the reflectance data is represented by 
data constituted of 9 bits or more, so that said data is expressed by the lower 8 bits thereof, and the gain computing 

25 means is a means for computing the gain based on the statistical quantity of the bit-shifted data, a common 8-bit 
calculator can be employed and the processing speed can be increased. 

[0064] Still further, if a GaN type semiconductor laser is employed as the excitation light source, the light source can 
be provided as a compact and low-cost light source; further, if the wavelength band thereof is in the range from 400-420 
nm, the fluorescent light can be caused to be generated efficiently. 

30 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0065] 

35 Figure 1 is a schematic drawing of the first embodiment of a fluorescent endoscope implementing the fluorescence 

image display apparatus according to the present invention, 

Figure 2 is a schematic drawing of the optical transmitting filter utilized in the fluorescent endoscope according to 
the first embodiment (the first thereof), 

Figure 3 is a schematic block diagram of the configuration of the image computing unit of the fluorescent endoscope 
40 according to the first embodiment of the present invention, 

Figure 4 is a drawing illustrating the multiplied of the gain, 
Figure 5 is a graph showing the display gradation curves of G and R, 

Figure 6 is a schematic block diagram of the configuration of the image computing unit of the fluorescent endoscope 
according to the second embodiment of the present invention, 
45 Figures 7A and 73 are graphs illustrating the intensity inversion, 

Figure 8 is a schematic block diagram of the configuration of the image computing unit of thefluorescent endoscope 
according to the third embodiment of the present invention. 

Figure 9 is a schematic block diagram of the configuration of the image computing unit of thefluorescent endoscope 
according to the fourth embodiment of the present invention, 
50 Figures 1 0A and 1 0B are graphs illustrating the dynamic range expansion process, 

Figure 11 is a drawing of the state in which the fluorescent endoscope according to the fourth embodiment has 
been provided with a foot switch or a hand operated switch, 

Figure 12 is a schematic block diagram of the configuration of the image computing unit of the fluorescent endo- 
scope according to the fifth embodiment of the present invention, 
55 Figure 13 is a schematic block diagram of the configuration of the image computing unit of the fluorescent endo- 

scope according to the sixth embodiment of the present invention, 

Figure 14 is a schematic block diagram of the configuration of the image computing unit of the fluorescent endo- 
scope according to the seventh embodiment of the present invention, 
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Figure 15 is a schematic block diagram of the configuration of the image computing unit of the fluorescent endo- 
scope according to the eighth embodiment of the present invention, 

Figure 16 is a schematic drawing of the optical transmitting filter utilized in the fluorescent endoscope according 

to the eighth embodiment (the second thereof), 
5 Figure 1 7 is a drawing illustrating the computation of the gain, 

Figure 18 is a schematic block diagram of the configuration of the image computing 

scope according to the ninth embodiment of the present invention, 

Figure 19 is a schematic block diagram of the configuration of the image computing 

scope according to the tenth embodiment of the present invention, 
10 Figure 20 is a schematic block diagram of the configuration of the image computing 

scope according to the eleventh embodiment of the present invention, 

Figure>21 is a schematic block diagram of the configuration of theimage computing 

scope according to the twelfth embodiment of the present invention, 

Figure 22 is a schematic block diagram of the configuration of the image computing 
is scope according to the thirteenth embodiment of the present invention, 

Figure 23 is a schematic block diagram of the configuration of the image computing 

scope according to the fourteenth embodiment of the present invention, 

Figure 24 is a schematic block diagram of the configuration of the image computing 

scope according to the fifteenth embodiment of the present invention, 
20 Figure 25 is a schematic block diagram of the configuration of the image computing 

scope according to the sixteenth embodiment of the present invention, and 

Figure 26 is a drawing illustrating the intensity distributions of the fluorescent light spectra of a tissue in the diseased 

state and of a tissue in the normal state. 

25 DESCRIPTION OF THE PREFERRED EMBODIMENTS 

[0066] Hereinafterthe preferred embodiments of the present invention will be explained with reference to the attached 
drawings. Fig. 1 is a schematic drawing a fluorescent endoscope implementing the fluorescence image display appa- 
ratus according to first embodiment of present invention. 

30 [0067] The fluorescent endoscope according to the first embodiment comprises: an endoscope insertion portion 1 00 
to be inserted into the primary nidus and areas of suspected secondary infection of a patient; an image data processing 
portion 1 for outputting as image data the data obtained of a living tissue (hereinafter referred to as a target subject); 
and a monitor 600 for displaying the image data outputted from the image data processing portion 1 as a visible image. 
[0068] The image data processing portion 1 comprises: an illuminating unit 110 provided with two light sources for 

35 emitting a white light Lw for obtaining a standard image (a reflectance image) and an excitation light Lr for obtaining 
a fluorescence image, respectively; an image detecting unit 300 for obtaining a fluorescence image Zj, which is formed 
of the fluorescent light emitted from a target subject 50 upon the irradiation thereof by the excitation light Lr, and a 
reflectance image Zs, which is formed of thejight reflected from the target subject 50 upon the irradiation thereof by 
the white light Lw containing a reference light Ls, and converting said obtained fluorescence image Zj and reflectance 

40 image Zs to respective digital values and outputting said digital values as respective image data; an image computing 
unit 400 for subjecting the image data of the fluorescence image outputted from the image detecting unit 300 to com- 
putational processes and outputting a pseudo color image data; a display signal processing unit 500 for converting a 
standard image to digital values to obtain an image data thereof, and converting said image data and the pseudo color 
image data outputted from the image computing unit 400 to video signals and outputting said video signals; and a 

45 control computer 200 for controlling the operation of each unit. Note that according to the first embodiment, the ob- 
tainment of a reflectance image Zs is not performed. 

[0069] The endoscope insertion portion 100 is provided with a light guide 101 extending internally to the distal end 
thereof, a CCD cable 102, and an image fiber 103. An illuminating lens 104 and an objective lens 105 are provided at 
the distal end portion of the light guide 101 and the CCD cable 102, that is, at the distal end of the endoscope insertion 

so portion 100. Further, the image fiber 103 is formed of a composite glass fiber, and a focusing lens 106 is provided at 
the distal end portion thereof. A standard image obtaining element 107 is connected to the distal end portion of the 
CCD cable 102, and a reflective prism 108 is attached to the standard image obtaining element 107. The light guide 
101 consists of a bundled excitation light guide 101a, which is formed of quartz glass fiber, and white light guide 101 b, 
which is formed of composite glass fiber, in the form of an integrated cable; the excitation light guide 101a and the 

55 white light guide 101b are connected to the illuminating unit 110. One end of the CCD cable 102 is connected to the 
image signal processing unit 500, and one end of the image fiber 103 is connected to the image detecting unit 300. 
Note that although not shown in the drawing, the distal end portion of the light guide 101 is formed as two eyelets. 
[0070] The illuminating unit 110 comprises: a GaN type semiconductor laser 111 that emits an excitation light Lr for 
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obtaining fluorescence images; a semiconductor laser power source 1 1 2 electrically connected to the GaN type sem- 
iconductor laser 111 ; an excitation light focusing lens 113 for focusing the excitation light emitted from the GaN type 
semiconductor laser 111 ; a white light source 114 that emits a white light Lw for obtaining standard images; a white 
light source power source 115 electrically connected to the white light source 114; and a white light focusing lens 116 
5 for focusing the white light emitted from the white light source 114. Further because the white light Lw emitted from 
the white light source 114 contains light within the wavelength band that can be used as the reference light Ls, the 
white light source 114 can also be employed as the reference light source described below. 

[0071] The image detecting unit 300 comprises: a collimator lens 301 that focuses a fluorescence image conveyed 
thereto via the image fiber 103; an excitation light cutoff filter 302 that cuts off light having a wavelength near that of 

10 the excitation light from the fluorescence image; an optical transmitting filter 303 that extracts light within a desired 
wavelength band from the fluorescence image transmitted by the excitation light cutoff filter 302; a filter rotating means 
304 for-rotating the optical transmitting filter 303; a fluorescent light focusing lens-305 for focusing the fluorescence 
image transmitted by the optical transmitting filter 303; a high-sensitivity fluorescent image obtaining element 306 for 
obtaining the fluorescent image focused by the fluorescent light focusing lens 305; and an AD converter 307 forcon- 

is verting the fluorescence image obtained by high-sensitivity fluorescent image obtaining element 306 to digital values 
to obtain image data thereof. 

[0072] As shown in Fig. 2, the optical transmitting filter 303 comprises two types of band pass filters: a band pass 
filter 303a and a band pass filter 303b. The band pass filter 303a is a band pass filter that transmits a fluorescence 
image formed of light having wavelengths within the 430-730 nm wide wavelength band; the band pass filler 303b is 

20 a band pass filter that transmits a fluorescence image formed of light having wavelengths within the 430-530 nm narrow 
wavelength band. Therefore, according to the image detecting unit 300: a fluorescent image data representing a wide 
band fluorescent image is obtained by use of a wide-band band pass filter 303a, and a fluorescent image data repre- 
senting a narrow band fluorescent image is obtained by use of a narrow-band band pass filter 303b. 
[0073] Figure 3 is a schematic block diagram of the configuration of the image computing unit 400. As shown in Fig. 

25 3, the image computing unit 400 comprises: a fluorescent image memory 401 that stores the wide band fluorescent 
image data WS and the narrow band fluorescent image data NS that has been obtained by the image processing unit 
300; a bit shifting means 402 for shifting the data of each pixel value among the pixel values of the wide band fluorescent 
image represented by the wide band fluorescent image data WS stored in the fluorescent image memory 401 that is 
constituted by nine bits or more so that each of said data is represented by eight bits of data or less; a statistical quantity 

30 computing means 403 provided with an 8-bit statistical quantity calculator for computing the statistical quantity of the 
wide band fluorescent image data WS outputted from the bit shifting means 402; a gain computing means 404 for 
computing, based on the statistical quantity outputted from the statistical quantity computing means 403, a gain g that 
the wide band fluorescent image data WS and the narrow band fluorescent image data NS are to be multiplied by; a 
gain multiplying means 405 for multiplying the wide band fluorescent image data WS and the narrow band fluorescent 

35 image data NS by the gain g obtained by the gain computing means 404 to obtain a wide band fluorescent image data 
WS' and a narrow band fluorescent image data NS', which have been multiplied by the gain g; a color gradation as- 
signing means 406 for assigning a green (G) color gradation to the wide band fluorescent image data WS' outputted 
from the gain multiplying means 405; a color gradation assigning means 407 for assigning a red (R) color gradation 
to the narrow band fluorescent image data NS' outputted from the gain multiplying means 405; and an image composing 

40 means 408 for colorizing and synthesizing the wide band fluorescent image data WS' and the narrow band fluorescent 
image data NS* outputted from the color gradation assigning means 406 and 407, respectively, to obtain a composite 
image data CS representing a composite image. 

[0074] Note that according to the current embodiment, the wide band fluorescent image data WS and the narrow 
band fluorescent image data NS have both been stored in the fluorescent image memory 401 ; however, each can be 

45 stored in respective separate memories. 

[0075] The display signal processing unit 500 comprises: an AD converter 501 that digitizes the visible image signal 
obtained by the standard image obtaining element 107 to obtain a standard image data; a standard image memory 
502 that stores the standard image data; and a video signal processing circuit 503 that converts the standard image 
data outputted by the standard image memory 502 and the composite-image image data outputted from the image 

50 composing means 408 to video signals and outputs said video signals. 

[0076] The monitor 600 is provided with a standard image monitor 601 and a composite image monitor 602. 
[0077] Next, the operation of the fluorescent endoscope according to the first embodiment of the configuration de- 
scribed above will be explained. In orderto obtain two fluorescence images, each formed of a mutually different wave- 
length band of fluorescent light, first, based on a signal outputted from the control computer 200, the semiconductor 

55 laser power source 112 is activated, and the GaN type semiconductor laser 111 emits excitation light Lr having a 
wavelength of 410 nm. The excitation light Lr emitted by the GaN type semiconductor laser 111 is transmitted by an 
excitation light focusing lens 11 3 and enters the excitation light guide 1 01 a; after being guided to the distal end of the 
endoscope insertion portion 1 00, said excitation light Lr passes through the illuminating lens 1 04 and is projected onto 
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the target subject 50. 

[0078] The fluorescence image Zj formed of the fluorescent light emitted from the target subject 50 upon the irradiation 
thereof by the excitation light Lr is focused by the focusing lens 106, enters the distal end of the image fiber 103, and 
enters the excitation light cutoff filter 302 via the image fiber 103. The fluorescent image Zj that has passed through 
5 the excitation light cutoff filter 302 enters the optical transmitting filter 303. Note that the excitation light cutoff filter 302 
is a long pass filter that transmits all fluorescent light having a wavelength of 420 nm or longer. Because the wavelength 
of the excitation light is 41 0 nm, the excitation light reflected from the target subject 50 is cutoff by this excitation light 
cutoff filter 302, and does not enter the optical transmitting filter 303. 

[0079] The filter rotating means 304 is driven based on a signal from the control computer 200, and after the fluo- 

10 rescent image Zj has passed through the band pass filter 303a, said fluorescent image Zj is focused by the fluorescent 
light focusing lens 305 and obtained as a wide band fluorescent image by the high sensitivity fluorescence image 
obtaining element 306. Further, after thefluorescent image Zj has passed through the band pass filter 303b, said 
fluorescent image Zj is focused by the fluorescent light focusing lens 305 and obtained as a narrow band fluorescent 
image by the high sensitivity fluorescence image obtaining element 306. The visible image signal from the high sen- 

15 sitivity fluorescence image obtaining element 306 is inputted to the AD converter 307, and after being digitized therein, 
is stored as a wide band fluorescent image data WS and a narrow band fluorescent image data NS in the fluorescent 
image memory 401 . Note that the wide band fluorescent image data WS obtained by the high sensitivity fluorescence 
image obtaining element 306 is stored within a wide band fluorescent image region (not shown) of the fluorescent 
image memory 401, and the narrow band fluorescent image data WS obtained by the high sensitivity fluorescence 

20 image obtaining element 306 is stored within a narrow band fluorescent image region (not shown). 

[0080] The wide band fluorescent image data WS stored in the fluorescent image memory 401 is inputted to the 
statistical quantity computing means 403 after being bit shifted by the bit shifting means 402 so as to be represented 
by an 8-bit data. The statistical quantity computing means 403 computes the average value m and the standard devi- 
ation o of each pixel of the wide band fluorescent image represented by the wide band fluorescent image data WS. 

25 Then, the average value m and the standard deviation a are inputted to the gain computing means 404, and the gain 
g is computed according to the above described Formula (2). Note that the maximum and minimum values of each 
pixel value of the wide band fluorescent image can be obtained, and the gain g computed according to the above 
described formula (1). Further, the gain g can be computed based the average value m and the standard deviation a 
computed of only the pixels included within a desired region within the fluorescent image (e.g., an image region having 

30 si particularly high level of interest). 

[0081] The computed gain g is inputted to the gain multiplying means 405, and the gain multiplying means 405 
multiplies the wide band fluorescent image data WS and the narrow band fluorescent image data NS by the inputted 
gain g. Note that the gain g that the wide band fluorescent image data WS and the narrow band fluorescent image 
data NS are multiplied by can be the same value; however, different values having a constant relationship may also 

35 be used. 

[0082] The wide band fluorescent image data WS* which has been multiplied by the gain g is inputted to the color 
gradation assigning means 406, and the color gradation assigning means 406 assigns a G color gradation thereto. 
Further, the narrow band fluorescent image data NS' which has been multiplied by the gain g is inputted to the color 
gradation assigning means 407, and the color gradation assigning means 407 assigns an R color gradation thereto. 

40 [0083] Here : as shown in Fig. 4, for a case in which the distribution of the pixel values of the wide band fluorescent 
image data WS and the narrow band fluorescent image data NS have a distribution such as that indicated by 10, 10' 
in the graph, by multiplying the gain g into the wide band fluorescent image data WS and the narrow band fluorescent 
image data NS, the distribution range of the pixel values thereof can be shifted to the high pixel value side of the graph, 
as indicated by 20, 20' in the graph. Then, based on the pixel value distribution range indicated by 20, 20' in the graph 

45 of Fig. 4, a G and R color gradation are assigned to the wide band fluorescent image data WS' and the narrow band 
fluorescent image data NS', respectively, according to the gradation process function shown in Fig. 5, for example. 
[0084] The wide band fluorescent image data WS' and the narrow band fluorescent image data NS' to which G and 
R color gradation are assigned to, respectively, are inputted to the image composing means 408; the image composing 
means 408 colorizes and synthesizes the image data NS' and WS' to obtain a composite image data CS representing 

so a composite image. 

[0085] The composite image data CS is inputted to the video signal processing circuit 503, and after being DA con- 
verted therein, is inputted to the monitor unit 600 and displayed as a composite image on the. composite image monitor 
602. Here, normal tissue appearing in the composite image displayed on the composite image monitor 602 is shown 
by a bright yellow-green color, and diseased tissue appearing therein is shown by a dark green color. 
55 [0086] Next, the operation occurring when a standard image is to be displayed will be explained. When a standard 
image is to be displayed, first, based on a control signal from the control computer 200, the white light source power 
source 1 1 5 is activated and white light Lw is emitted from the white light source 1 1 4. The white light Lw enters the white 
light guide 1 01 b via the white light focusing lens 1 1 6, and after being guided to the distal end of the endoscope insertion 
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portion 100, said white light Lw is emitted onto the target subject 50 from the illuminating lens 104. The light reflected 
from the target subject 50 upon the irradiation thereof by the white light Lw is focused by the objective lens 1 05, reflected 
by the reflective prism 108, and focused onto the standard image obtaining element 107. The visible image signal 
obtained by the standard image obtaining element 107 is inputted to the AD converter 501, and after being digitized 

5 therein, is stored as a standard image data in the standard image memory 502. The standard image data stored in the 
standard image memory 502 is inputted to the video signal processing circuit 503, and after being DA converted therein, 
is inputted to the monitor unit 600 and displayed as a visible image on the standard image monitor 601 . 
[0087] The continuous operations occurring when a composite image or a standard image is to be obtained are 
controlled by the control computer 200. 

10 [0088] According to the above described endoscope implementing the fluorescence image obtaining apparatus ac- 
cording to the first embodiment of the present invention: a statistical quantity computing means 403 for computing the 
statistical quantity of the distribution of the pixel values of a wide band fluorescent image represented by a wide band 
fluorescence image data WS is provided; because the gain g is computed based on said statistical quantity and the 
wide band fluorescence image data WS and the narrow band fluorescence image data IMS are multiplied by said gain, 

15 regardless of the intensity of the fluorescent light emitted from the target subject 50, a composite image data CS formed 
from a wide band fluorescence image data WS and a narrow band fluorescence image data NS having a desired pixel 
value can be obtained, and the composite image can be made to have a desired luminosity. That is to say, the luminosity 
of the fluorescence image, which is an effect of the intensity of the fluorescent light, can be adjusted so as to be within 
a desired range, whereby the distinguishability of the tissue state of the target subject can be improved. 

20 [0089] Further, because the statistical quantity has been taken as a combination of the average value m and the 
standard deviation o of the distribution of the pixel values of the wide band fluorescence image data WS, the compu- 
tation of the statistical quantity can be performed comparatively easily, and an appropriate display gradation can be 
assigned. 

[0090] Still further, for cases in which the statistical quantity computing means 403 is a means for computing the 
25 statistical quantity from a desired region of a reflectance image : the amount of computation required can be reduced. 
[0091] In addition, because a bit shifting means 402 has been provided for shifting the data of the pixel values of the 
wide band fluorescence image data WS for cases in which said pixel values are represented by nine or more bits of 
data, so that said data is constituted of eight bits of data, and the statistical quantity computing means 403 is a means 
for computing the statistical quantity based on the bit shifted data, a common 8-bit calculator can be used as the 
30 statistical quantity computing means 403, and the speed with which the computational processes are performed can 
be increased. 

[0092] Next, an endoscope implementing the fluorescence image obtaining apparatus according to the second em- 
bodiment of the present invention will be explained. According to the endoscope implementing the fluorescence image 
obtaining apparatus according to the second embodiment: the image computing unit 400 of the first embodiment inverts 

35 the intensity of the narrow band fluorescent image data NS', which has been multiplied by the gain g, to obtain a reverse 
narrow band fluorescent image data NS"; and assigns a R color gradation is to the reverse narrow band fluorescent 
image data NS" . Therefore, as shown in Fig. 6, the image computing unit 400 of the endoscope according to the second 
embodiment is provided with an intensity inverting means 41 0 for inverting the intensity of the narrow band fluorescent 
image data NS', which has been multiplied by the gain g. 

40 [0093] The intensity inverting means 410 subtracts, for cases in which the narrow band fluorescent image data NS' 
is represented by 8-bit data, each pixel value of the fluorescent image represented by the narrow band fluorescent 
image data NS' from 255 to obtain a subtraction value; this subtraction value is taken as the pixel value of the pixels 
of the fluorescent image of which the intensity has been inverted. Note that instead of subtracting from 255, the recip- 
rocal of the pixel values (i.e., the 1/pixel value) can be taken as the pixel values of the fluorescent image of which the 

45 intensity has been inverted. 

[0094] Hereinafter the operation of the second embodiment will be explained. Note that because the processes up 
until the multiplication of the fluorescent image data by the gain g are the same as those of the first embodiment, further 
explanation thereof has been omitted. According to the second embodiment: the gain g is computed based on the wide 
band fluorescence image data WS; the narrow band fluorescent image data NS is multiplied by the gain g to obtain a 

so narrow band fluorescent image data NS'; the narrow band fluorescent image data NS' is inputted to the intensity in- 
verting mean 410; the intensity inverting means 410 inverts the intensity of the narrow band fluorescent image data 
NS' to obtain a reverse narrow band fluorescent image data NS", assigns an R color gradation to the reverse narrow 
band fluorescent image data NS M , and then combines the reverse narrow band fluorescent image data NS" and the 
wide band fluorescence image data WS\ to which a green color gradation has been assigned, to obtain a composite 

55 image data CS. 

[0095] Here : the effect of the inversion of the intensity will be explained. Fig. 7 is a graph illustrating the effect of the 
intensity inversion. As shown in Fig. 7A, if a two-dimensional colorized space having a horizontal axis G and a vertical 
axis R is considered, before the inversion of the intensity is performed, because the ratio of the wide band fluorescence 
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Image data WS' and the narrow band fluorescence image data NS' of the normal tissue is such that the wide band 
fluorescence image data WS' side is slightly larger, the normal tissue is shown as a bright yellow-green color in the 
composite image. On the other hand, the intensity of the diseased portion is reduced, and in comparison to the normal 
tissue, because the ratio of the wide band fluorescence image data WS* and the narrow band fluorescence image data 

5 NS' of the normal tissue is such that value of the wide band fluorescence image data WS' is larger, opposed to that of 
the narrow band fluorescence image data NS'; accordingly, the diseased tissue is shown as a dark green color in the 
composite image. In this manner, although the normal tissue and the diseased tissue are shown as a greenish yellow 
color and a dark green color, respectively, in the composite image, because the difference in the hue contrast is slight, 
there are cases in which it is difficult to distinguish between the normal tissue and the diseased tissue. 

w [0096] In contrast to this, as shown in Fig. 7B, if the intensity of the narrow band fluorescent image data NS' is 
inverted, because the change occurring in the intensity of the fluorescent light emitted from the diseased tissue occurs 
as an reverse phase change in the wide band fluorescence image data WS' and the narrow band fluorescence image 
data NS', the value of the narrow band fluorescent image data NS' becomes larger than that of the wide band fluores- 
cence image data WS'. Therefore, the normal tissue is shown as a bright green color and the diseased tissue as a 

'5 bright red color, and the difference between the hue contrast of the normal tissue and the diseased tissue becomes 
enlarged in comparison to the state prior to the inversion of the intensity of the narrow band fluorescent image data 
NS'. Therefore, according to the second embodiment described above, by inverting the intensity of the narrow band 
fluorescent image data NS*, the difference between the normal tissue and the diseased tissue appearing in the com- 
posite image can be rendered more clearly, whereby the distinguishability of the tissue state of the target subject can 

20 be improved a level. 

[0097] Next, an endoscope implementing the fluorescence image obtaining apparatus according to the third embod- 
iment of the present invention will be explained. According to the endoscope implementing the fluorescence image 
obtaining apparatus according to the third embodiment: the image computing unit 400 of the second embodiment 
inverts the intensity of the narrow band fluorescent image data NS', which has been multiplied by the gain g, to obtain 

25 a reverse narrow band fluorescent image data NS"; then, multiplies the reverse narrow band fluorescent image data 
NS" by a predetermined constant a (a > 1) to obtain a constant-multiplied reverse narrow band fluorescence image 
NS"; and assigns a R color gradation to the constant-multiplied reverse narrow band fluorescent image data NS", which 
has been multiplied by the constant a. Therefore, as shown in Fig. 8, the image computing unit 400 of the endoscope 
according to the third embodiment comprises: an intensity inverting means 41 0 for inverting the intensity of the narrow 

30 band fluorescent image data NS', which has been multiplied by the gain g, to obtain a reverse narrow band fluorescent 
image data NS"; and a constant multiplying means 41 2 for multiplying the reverse narrow band fluorescent image data 
NS" by a predetermined constant a to obtain a constant-multiplied reverse narrow band fluorescent image data NS". 
[0098] Hereinafter the operation of the third embodiment will be explained. Note that because the processes up until 
the multiplication the fluorescent image data by the gain g are the same as those of the first embodiment further 

35 explanation thereof has been omitted. According to the third embodiment: the gain g is computed based on the wide 
band fluorescence image data WS; the narrow band fluorescent image data NS is multiplied by the gain g to obtain a 
narrow band fluorescent image data NS'; the narrow band fluorescent image data NS' is inputted to the intensity in- 
verting mean 410; and the intensity invertingjneans 410 inverts the intensity of the narrow band fluorescent image 
data NS' to obtain a reverse narrow band fluorescent image data NS". Then, the reverse narrow band fluorescent 

40 image data NS" is inputted to the constant multiplying means 412, and the constant multiplying means 412 multiplies 
the reverse narrow band fluorescent image data NS" by a predetermined constant a to obtain a constant-multiplied 
reverse narrow band fluorescent image data NS". An R color gradation is assigned to the narrow band fluorescence 
image data NS", which has been multiplied by the constant a, a G color gradation is assigned to the wide band fluo- 
rescence image data WS', then the two are combined to form a composite image data CS. 

45 [0099] In the case that the narrow band fluorescence data NS' is intensity inverted, the dark portions included in the 
composite image other than diseased tissue also become red in color, thereby making ambiguous the difference be- 
tween diseased tissue and these dark portions. Therefore, according to the third embodiment, the constant multiplying 
means 41 2 multiplies a constant a to the narrow band fluorescence data NS', which has been intensity inverted, where- 
by the effect causing the dark portions occurring in the composite image to also become red in color can be suppressed, 

50 preventing the misrecognition of the diseased tissue and the portions that are simply dark, and thereby improving the 
distinguishability of the tissue state by a level. 

[0100] Note that according to the second and third embodiments, although the intensity of the narrow band fluores- 
cent image data NS' has been inverted, the intensity of the wide band fluorescence image data WS may be inverted 
instead. 

55 [0101] Next, an endoscope implementing the fluorescence image obtaining apparatus according to the fourth em- 
bodiment of the present invention will be explained. According to the endoscope implementing the fluorescence image 
obtaining apparatus according to the fourth embodiment: the image computing unit 400 of the first embodiment subjects 
the narrow band fluorescent image data NS* and the wide band fluorescent image data WS', which have been multiplied 
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by the gain g, to a dynamic range expansion process, based on the statistical quantity computed by the statistical 
quantity computing means 403. Therefore, as shown in Fig. 9, the image computing unit 400 of the endoscope according 
to the fourth embodiment is provided with a dynamic range expanding means 414 for subjecting the narrow band 
fluorescent image data NS' and the wide band fluorescent image data WS' to a dynamic range expansion process. 
5 [0102] As shown in the Formula (3) below, the dynamic range expanding means 41 4 computes, based on the average 
value m and the standard deviation a of each pixel of the wide band fluorescent image computed by the statistical 
quantity computing means 403, the distribution range of the pixel values of each fluorescence image represented by 
the wide band fluorescence image data DWS' and the narrow band fluorescent image data DNS 1 , which have been 
subjected to the dynamic range expansion process. Note that in the Formula (3), b = 2, for example. 

10 

Distribution range = m - b x o to m + b x a (3) ...... 

[0103] Then, if the minimum value (Min) is designated as m - b x o, the maximum value (Max) as m + b x a, each 
*5 pixel value of each fluorescent image that has been subjected to the dynamic range expansion process can be com- 
puted by use of the function g (x) (where x equals the pixel values of the narrow band fluorescent image and the wide 
band fluorescent image which have been multiplied by the gain g) shown in the Formula (4) below. 

20 g (x) = (x - Min) / (Max - Min) (4) 

[0104] Hereinafter the operation of the fourth embodiment will be explained. Note that because the processes up 
until the multiplication of the gain g into the fluorescent image data are the same as those of the first embodiment, 
further explanation thereof has been omitted. According to the fourth embodiment: the gain g is computed based on 

25 the wide band fluorescence image data WS; the narrow band fluorescent image data NS and the wide band fluores- 
cence image data WS are multiplied by the gain g to obtain a narrow band fluorescent image data NS' and a wide 
band fluorescence image data WS', which have been multiplied by the gain g; the narrow band fluorescent image data 
NS' and the wide band fluorescence image data WS* are inputted to the dynamic range expanding means 414, and 
are subjected to the dynamic range expansion process therein to obtain a the wide band fluorescence image data 

30 DWS' and a narrow band fluorescent image data DNS'. The wide band fluorescence image data DWS' and the narrow 
band fluorescent image data DNS* are assigned an R color gradation and a G color gradation, respectively, and are 
then combined to obtain a composite image data CS. 

[01 05] Here, as shown in Fig. 1 0A : for cases in which the distribution of the pixel values of the wide band fluorescence 
image and the narrow band fluorescent image prior to the subjection thereof to the dynamic range expansion process 

35 is that indicated by 12, 12' in the graph, because the distribution range thereof is present on only a portion of the display 
gradation curve 32 of the composite image monitor 602, the contrast of the composite image formed thereof would not 
be very high. In contrast to this, by subjecting the wide band fluorescence image and the narrow band fluorescent 
image to the dynamic range expansion process, the distribution range of the pixel values thereof can be made to span 
substantially the entire area of the display gradation curve 32 of the composite image monitor 602, as indicated by 14, 

40 14' in the graph shown in Fig. 14B, whereby the contrast of the composite image formed thereof can be made higher. 
Accordingly, the change in the tissue state of the target subject 50 can be represented more accurately in the composite 
image, whereby the distinguishability of the tissue state of the target subject 50 can be further improved. 
[0106] Note that for cases in which the statistical quantity computing means 403 computes the Max and Min values 
of each pixel of the wide band fluorescence image, the dynamic range expanding means 414 can compute the distri- 

45 bution range of the pixel values of each fluorescent image represented by the wide band fluorescence image data 
DWS' and the narrow band fluorescent image data DNS', which have been subjected to the dynamic range expansion 
process, by use of the Formula (5) below. Note that in Formula (5), cand dare arbitrary constants. 

50 Distribution range = (Max + Min) / 2 - c X (Max - Min)/2 

to (Max + Min) / 2 + d X (Max - Min)/2 (5) 

[0107] Further, according to the fourth embodiment, when the normal tissue and the diseased tissue are adequately 
55 interspersed there is no problem; however, for cases in which only normal tissue or only diseased tissue appears in 
the composite image, if said composite image is subjected to the dynamic range expansion process, because the 
change within the tissue state of the normal tissue or within the tissue state of the diseased tissue becomes assigned 
to the dynamic range of the composite image monitor 602, it becomes impossible to discern whether the displayed 
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composite image is a normal tissue or a diseased tissue. 

[0108] Accordingly, the performance of the dynamic range expansion process can also be performed only at those 
times desired by the operator of the endoscope. In this case ; the dynamic range expansion means 414 can be switched 
on and off by a footswitch 210 or a hand held switch 212 as shown in Figure 11. 

5 [01 09] Further, according to the fourth embodiment described above, the dynamic range expanding means 41 4 has 
been provided on the first embodiment to perform the dynamic range process; however it is also possible to perform 
the same dynamic range expansion process in the second and third embodiments. In this case, according to the second 
embodiment, the dynamic range expansion process can be performed on the reverse narrow band fluorescent image 
data NS", which has been obtained by the reversal of the intensity of the narrow band fluorescent image data NS' by 

10 the intensity inverting means 410; in the third embodiment, the dynamic range expansion process can be performed 
on the constant-multiplied reverse narrow band fluorescent image data NS". 

[0110] Note that according to the first through the fourth embodiments described above, a G color gradation has 
been assigned to the wide band fluorescence image data WS' (included those of which the dynamic range has been 
expanded) and an R color gradation has been assigned to the narrow band fluorescent image data NS' (including 

is those of which the dynamic range has been expanded, those of which the intensity thereof has been inverted, and 
those that have been multiplied by the constant a); however, an R color gradation can be assigned to the wide band 
fluorescence image data WS', and a G color gradation can be assigned to the narrow band fluorescent image data 
NS'. Further, in addition to the G and R color gradations, a B color gradation may be assigned as well. In this case, a 
G and a B color gradation can be assigned to the wide band fluorescence image data WS', and an R color gradation 

20 can be assigned to the narrow band fluorescent image data NS'; alternatively, a G and a B color gradation can be 
assigned to the narrow band fluorescence image data NS', and an R color gradation can be assigned to the wide band 
fluorescent image data WS'. Note that the change in the assignment of the color gradations may be performed after 
the fluorescent images have been subjected to the dynamic range expansion process, the constant a multiplying proc- 
ess, or the intensity inversion process. 

25 [0111] Next, an endoscope implementing the fluorescence image obtaining apparatus according to the fifth embod- 
iment of the present invention will be explained. According to the endoscope implementing the fluorescence image 
obtaining apparatus according to the fifth embodiment: as in the first embodiment, a hue image data is obtained of the 
narrow band fluorescent image data NS' and the wide band fluorescent image data WS', which has been multiplied by 
the gain g, and a luminosity image data is obtained of the wide band fluorescent image data WS', and the hue image 

30 data and the luminosity image data are combined to obtain a composite image data. Therefore, as shown in Fig. 12, 
the image computing unit 400 of the endoscope according to the fifth embodiment comprises: a hue image data forming 
means 420, instead of the hue gradation assigning means 406, the hue gradation assigning means 407 and the image 
composing means 408, for forming a hue data H, which represents a hue, from the narrow band fluorescent image 
data NS* and the wide band fluorescent image data WS', which has been multiplied by the gain g; a luminosity image 

35 data forming means 422 for forming, based on the wide band fluorescent image data WS*, a luminosity image data V 
representing a brightness; and an image composing means 424 for combining the hue data H and the luminosity image 
data V to obtain a composite image data CS\ 

[0112] The hue image data forming means^420 outputs the wide band fluorescent image data WS' and the narrow 
band fluorescent image data NS', which has been multiplied by the gain g, to respectively different color planes (e.g., 
40 G ; R), and forms, based on the additive color mixture method, a color added and mixed image data representing a 
color added and mixed image ; then, by computing, based on this color added and mixed image data, the hue value, 
of the color added and mixed image represented by said color added and mixed image data, occurring in the Munsell 
color system, the hue image data forming means 420 forms a hue data value H. 

[0113] The luminosity image data forming means 422 refers to a prerecorded look-up table correlating the range of 
45 the pixel values of the wide band fluorescent image which has been multiplied by the gain g represented by the wide 
band fluorescent image data WS* and a luminosity V (Value) occurring in the Munsell color system, and forms a lumi- 
nosity image data V. 

[01 1 4] Hereinafter the operation of the fifth embodiment will be explained. Note that because the processes up until 
the multiplication of the fluorescent image data by the gain g are the same as those of the first embodiment, further 

so explanation thereof has been omitted. According to the fifth embodiment: the narrow band fluorescent image data NS' 
and the wide band fluorescence image data WS', which has been multiplied by the gain g, are inputted to the hue 
image data forming means 420. Next, the hue image data forming means 420 outputs the wide band fluorescent image 
data WS' and the narrow band fluorescent image data NS' to respectively different color planes, and forms, based on 
the additive color mixture method, a color added and mixed image data representing a color added and mixed image ; 

55 then, by computing, based on this color added and mixed image data, the hue value of the color added and mixed 
image represented by said color added and mixed image data and occurring in the Munsell color system, the hue 
image data forming means 420 forms a hue data value H. 

[0115] Meanwhile, the wide band fluorescent image data WS', which has been multiplied by the gain g, is inputted 
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to the luminosity image data forming means 422; then : the luminosity image data forming means forms, based on the 
range of the pixel values of the wide band fluorescent image represented by the wide band fluorescent image data 
WS' and the look-up table., a luminosity image data V determining a luminosity V (Value) occurring in the Munsell color 
system. 

5 [01 1 6] The hue image data H and the luminosity image data V are inputted to the image composing means 424, and 
the image composing means 424 forms a composite image data CS'. In this case, because a saturation is required in 
addition to the hue and luminosity, when the composite image CS' is to be composed, the largest value of each hue 
and each luminosity is set as a saturation value S occurring in the Munsell color system, and the composite image CS' 
is formed by performing an RGB conversion process. The formed composite image CS 1 is displayed on the composite 

10 image monitor 602. Note that the setting of the saturation may alternatively be set according to the preferences of the 
operator. 

[011-7] - Heres according to the above-described fifth embodiment, by combining a^hue image^data H is formed from 
the wide band fluorescent image and the narrow band fluorescent image with a luminosity image data V to form a 
composite image CS', the hue of the composite image CS 1 displayed on the composite image monitor 602 becomes 
75 a hue that reflects the tissue state of the target subject 50, and the luminosity reflects the form of the target subject 
50. Accordingly, data relating to the tissue state of the target subject 50 as well as data relating to the form of the target 
subject 50 can be displayed concurrently in a single image. 

[01 1 8] Next, an endoscope implementing the fluorescence image obtaining apparatus according to the sixth embod- 
iment of the present invention will be explained. According to the endoscope implementing the fluorescence image 

20 obtaining apparatus according to the sixth embodiment: the narrow band fluorescent image data NS' and the wide 
band fluorescent image data WS', which have been multiplied by the gain g, as in the fifth embodiment, are subjected 
to a dynamic range expansion process, based on the statistical quantity computed by the statistical quantity computing 
means 403. Therefore, as shown in Fig. 13, the image computing unit 400 of the endoscope according to the sixth 
embodiment is provided with a dynamic range expanding means 426 for subjecting the wide band fluorescent image 

25 data WS\ which has been multiplied by the gain g, to a dynamic range expansion process. Note that because the 
dynamic range expanding means 426 performs the same process as that performed by the dynamic range expanding 
means 414 of the fourth embodiment, a detailed explanation thereof has been omitted. 

[0119] In this manner, by providing the dynamic range expanding means 426, because the distribution of the lumi- 
nosity image data V can be made to span substantially the entire area of the display gradation curve of the composite 
30 image monitor 602, the contrast of the composite image formed thereof can be made higher. Accordingly, the change 
in the tissue state of the target subject 50 can be represented more accurately in the composite image, whereby the 
distinguishability of the tissue state of the target subject 50 can be further improved. 

[0120] Note that according to the sixth embodiment, the dynamic expansion process can be preset so as to be 
performed for each image, or can be performed only when so desired by the operator of the endoscope, by use of a 

35 foot switch 210 or a hand operated switch 212, in the same manner as in the fourth embodiment. 

[0121] Further, according to the above-described fifth and sixth embodiments, although hue image data H and lumi- 
nosity image data V have been formed in addition to the processes performed in the first embodiment, it is also possible 
that a hue image data H and luminosity image,data V be formed and combined to obtain a composite image data CS' 
in the second through fourth embodiments described above. In this case, according to the second embodiment, the 

40 hue image data H can be formed utilizing the reverse narrow band fluorescence image NS"; according to the third 
embodiment, the hue image data H can be formed utilizing the constant-multiplied reverse narrow band fluorescence 
image NS". Further, according to the fourth embodiment, the hue image data H can be formed utilizing the wide band 
fluorescence image DWS' and the narrow band fluorescence image DNS', which have been subjected to the dynamic 
range expansion process. 

45 [0122] Still further, according to the above-described fifth and sixth embodiments, although the luminosity image 
data V has been formed, based on the wide band fluorescent image data WS', which has been multiplied by the gain 
g, by the luminosity image data forming means 422, the luminosity image data V may also be formed based on the 
narrow band fluorescent image data NS', which has been multiplied by the gain g. 

[0123] Note that according to the fifth and sixth embodiments, although the hue image H (a uniform saturation) has 
so been computed, these embodiments are not limited thereto: an image corresponding to the the X,Y components of an 
XYZ color space; the ab components of a Lab color space; the uv components of a Luv color space; the a*b* components 
of a uniform La*b* color space; the u*v* components of a uniform Lu*v* color space; etc. can also be computed. 
[0124] Further, according to the fifth and sixth embodiments, although the luminosity image data V has been formed, 
based on the wide band fluorescent image data WS', which has been multiplied by the gain g, by the luminosity image 
55 data forming means 422, the luminosity image data V can be formed based on the wide band fluorescent image data 
WS, which has not yet been multiplied by the gain g, as per the seventh embodiment shown in Fig. 14. In this case, it 
is preferable that it be possible to switch the data from which the luminosity image data V is to be formed between the 
image data prior to the multiplication thereof by the gain g or the image data which has been multiplied by the gain g. 
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[0125] Here : in the case of forming the luminosity image data V from the wide band fluorescent image data WS\ 
which has been multiplied by the gain g, if there is a large amount of variation in the distance between the target subject 
50 and the distal end of the endoscope insertion portion 1 00, because there is a corresponding large amount of change 
in the gain, the brightness of the displayed composite image also varies a large amount. Therefore, by forming the 

5 luminosity image data V based on the wide band fluorescent image data WS, which has not yet been multiplied by the 
gain g, the aforementioned large variations of the brightness of the displayed composite image can be prevented. 
[0126] Further, according to the first through the seventh embodiments described above, although the gain g has 
been computed based on the statistical quantity of the wide band fluorescent image data WS, the gain g can also be 
computed based on the narrow band fluorescent image data NS. 

10 [0127] Next, an endoscope implementing the fluorescence image obtaining apparatus according to the eighth em- 
bodiment of the present invention will be explained. According to the endoscope implementing the fluorescence image 
obtaining apparatus according to the eighth embodiment: whereas in the first embodiment the gain is computed based 
on the statistical quantity of the wide band fluorescent image data WS, in the eighth embodiment, the gain is computed 
based upon the statistical quantity of the reflectance image data RS obtained from the reflectance image Zs formed 

15 from the light reflected from the target subject 50 upon the irradiation thereof by the reference light Ls. 

[0128] According to the configuration of the endoscope of the eighth embodiment: the optical transmitting filter 303 
of the image detecting unit 300 of the first embodiment is provided as an optical transmitting filter 701 ; further, as shown 
in Fig. 15, the fluorescence image memory 401 of the image computing unit 400 is provided as a fluorescent image/ 
standard image memory 801; further comprising a bit shifting means 802 for shifting the number of bits constituting 

20 the data of the reflectance image data RS; a statistical quantity computing means 803 for computing the statistical 
quantity of the bit shifted reflectance image data RS; and a gain computing means 804 for a computing a gain rg based 
on the statistical quantity obtained by the statistical quantity computing means 803. 

[0129] As shown in Fig. 16, the optical transmitting filter 701 is formed of three types of band pass filters: 701a, 701b, 
and 701c. The band pass filter 701a is a band pass filter for transmitting a wide band fluorescent image formed of 
25 fluorescent light having wavelengths in the 430-730 nm wavelength band. The band pass filter 701b is a band pass 
filter for transmitting a narrow band fluorescent image formed of fluorescent light having wavelengths in the 430-530 
nm wavelength band. The band pass filter 701c is a band-pass filter for transmitting a reflectance image formed of 
light having wavelengths in the 750-900 nm wavelength band. 

[0130] Further, the fluorescent image/standard image memory 801 comprises a wide band fluorescence image re- 
30 cording region, a narrow band fluorescence image recording region, and a reflectance image recording region: the 
fluorescence images transmitted by the band pass filters 701a, 701b are stored in the respective wide band fluores- 
cence image recording region and narrow band fluorescence image recording region; and the reflectance image trans- 
mitted by the band pass filter 701c is stored in the reflectance image recording region. . 

[0131] The statistical quantity computing means 803 computes the average value rm and the standard deviation ra 
35 of each pixel of the reflectance image represented by the reflectance image data RS. Then, the average value rm and 
the standard deviation ra are inputted to the gain computing means 804, and the gain rg is computed according to the 
following Formula (6). 

40 Gain upper limit = f (DR x a/ (rm + b x ra)) (6) 

[0132] The function f (x) is a correction function reflecting the intensity ratio of the reflected light intensity (i.e., the 
value of the reflectance image data RS) and the fluorescent light intensity (i.e., the values of the wide band fluorescence 
image data WS and the narrow band fluorescence image data NS). Fig. 17 is a graph illustrating the relation of the 

45 distance between the target subject 50 and the distal end of the endoscope insertion portion 100 and the intensity of 
the reflectance and fluorescence images. Because the distal end portion of the light guide 1 01 is formed as two eyelets, 
the intensity of the reflectance and fluorescence light is reduced non-linearly up until the distance z from the target 
subject 50 becomes zO, as shown in Fig. 1 7; at a distance larger than zO, the intensity of the reflectance and fluores- 
cence light is reduced in inverse proportion to the square of the distance z. This is due to the fact that although the 

50 merging of the light emitted from two locations occurs according to a gaussian distribution if the distance z is greater 
than or equal to zO, for cases in which the distance z is less than zO, the merging of the light emitted from two locations 
does not occur according to a gaussian distribution. 

[0133] Therefore, for cases in which the gain rg is computed based on the reflectance image data RS, the manner 
in which the distribution of the pixel values of the fluorescence and reflectance images which have been multiplied by 
55 said gain rg changes is such that said change differs in accordance to the length, short or long, of the distance z. 

[0134] Accordingly, in a case, for example, in which f (x)= px, at locations for which the distance is short, the change 
in distribution becomes expressed by a variable (e.g., a value that approaches 1 as the distance z becomes shorter) ; 
by setting the coefficient p so that it is a constant at locations for which the distance is long, a gain rg in which the 
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change to the correction function due to the distance 7 is reduced can be obtained. Note that because it is not possible 
to detect the distance z directly, the value of the coefficient p can be determined based upon the value of the reflectance 
image data RS. That is to say, when the data value of the reflectance image data RS is large, the coefficient p is set 
as a value close to 1 ; when the data value is small, the coefficient p can be a value computed based on the ratio of 
5 the fluorescent images and the reflectance image. 

[01 35] Note that by obtaining the maximum value (Max) and the minimum value (Min) of each pixel of the wide band 
fluorescence image, the gain rg may also be computed by use of the following equation (7). In addition, the gain rg 
may be computed based solely on the pixel values for a desired region of the reflectance image (e.g., a region of the 
image that warrants observation with particular attention). 

10 

Gain upper limit = f [DR x a/ {(rMax + rMin)/2 + 

bx(rMax-rMin)/2) (7) 

15 

[0136] Hereinafter, the operation of the eighth embodiment will be explained. According to the eighth embodiment: 
the filter rotating means 304 is driven based on a signal from the control computer 200, and after the fluorescent image 
Zj has passed through the band pass filter 701 a, said fluorescent image Zj is focused by the fluorescent light focusing 
lens 305 and obtained as a wide band fluorescent image by the high sensitivity fluorescence image obtaining element 

20 306. Further, after the fluorescent image Zj has passed through the band pass filter 701 b, said fluorescent image Zj is 
focused by the fluorescent light focusing lens 305 and obtained as a narrow band fluorescent image by the high sen- 
sitivity fluorescence image obtaining element 306. The visible image signals from the high sensitivity fluorescence 
image obtaining element 306 are inputted to the AD converter 307, and after being digitized therein, are stored as a 
wide band fluorescent image data WS and a narrow band fluorescent image data NS in the respective wide band 

25 fluorescent image recording region and narrow band fluorescent image recording region of the reflectance image/ 
fluorescent image memory 801 . 

[01 37] On the other hand, when a reflectance image is to be obtained: first, based on a control signal from the control 
computer 200, the white light source power source 115 is activated and white light Lw is emitted. The white light Lw 
contains reference light Ls having wavelengths from 750 -900 nm. The white light Lw enters the white light guide 101b 
30 via the white light focusing lens 116, and after being guided to the distal end of the endoscope insertion portion 100, 
said white light Lw is emitted onto the target subject 50 from the illuminating lens 104. 

[0138] The light reflected from the target subject 50 upon the irradiation thereof by the white light Lw is focused by 
the focusing lens 106, enters the distal end of the image fiber 103, and enters the excitation light cutoff filter 302 via 
the image fiber 103. The reflectance image Zs that has passed through the excitation light cutoff filter 302 enters the 

35 optical transmitting filter 303. 

[01 39] The filter rotating means 304 is driven, based on a signal from the control computer 200, and after the reflect- 
ance image Zs has passed through the band pass filter 701c, said reflectance image Zs is focused by the fluorescent 
light focusing lens 305 and obtained as a standard image by the high sensitivity fluorescence image obtaining element 
306. The visible image signal from the high sensitivity fluorescence image obtaining element 306 is inputted to the AD 

40 converter 307 : and after being digitized therein, is stored as a standard image data RS in the reflectance image re- 
cording region of the reflectance image/fluorescent image memory 801 . 

[0140] The standard image data RS stored in the reflectance image/fluorescent image memory 801 is inputted to 
the statistical quantity computing means 803 after being bit shifted by the bit shifting means 802 so as to be represented 
by 8-bit data. The statistical quantity computing means 803 computes the statistical quantity. The statistical quantity 

45 js inputted to the gain computing means 804, and the gain computing means 804 computes the gain rg based on said 
statistical quantity. Then, in the same manner as in the first embodiment, the wide band fluorescent image data WS 
and the narrow band fluorescent image data NS are multiplied by the gain g to obtain a wide band fluorescent image 
data WS' and a narrow band fluorescent image data NS'. Further a G color gradation is assigned to the wide band 
fluorescent image data WS' and an R color gradation is assigned to the narrow band fluorescent image data NS 1 ; these 

50 two colorized wide band fluorescent image data WS' and narrow band fluorescent image data NS* are then combined 
to obtain a composite image data CS. 

[01 41 ] Here, the intensity of the light reflected from the target subject 50 upon the irradiation thereof by the reference 
light Ls is larger than the intensity of the wide band fluorescent light emitted from the target subject 50 upon the irra- 
diation thereof by the excitation light. Therefore, the computation of the gain rg, based on the statistical quantity, can 
55 be performed more advantageously in comparison to the first embodiment; whereby the distinguishability of the tissue 
state of the target subject 50 appearing in the composite image formed according to the current embodiment can be 
improved a level. 

[0142] Next, an endoscope implementing the fluorescence image obtaining apparatus according to the ninth em- 
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bodiment of the present invention will be explained. According to the endoscope implementing the fluorescence image 
obtaining apparatus according to the ninth embodiment: the image computing unit 400 of the eighth embodiment inverts 
the intensity of the narrow band fluorescent image data NS\ which has been multiplied by the gain rg ? to obtain a 
reverse narrow band fluorescent image data NS" as in the second embodiment; and assigns a R color gradation to 

5 the reverse narrow band fluorescent image data NS". Therefore, as shown in Fig. 18, the image computing unit 400 
of the endoscope according to the ninth embodiment is provided with an intensity inverting means 410 for inverting 
the intensity of the narrow band fluorescent image data NS', which has been multiplied by the gain rg. 
[01 43J Hereinafter the operation of the ninth embodiment will be explained. Note that because the processes up until 
the multiplication of the fluorescent image data by the gain rg are the same as those of the first embodiment, further 

10 explanation thereof has been omitted. According to the ninth embodiment: the gain rg is computed based on the re- 
flectance image data RS; the narrow band fluorescent image data NS is multiplied by the gain rg to obtain a narrow 
band fluorescent image* data r NS'; the narrow band fluorescent image data NS 1 is inputted to the intensity inverting 
means 41 0; the intensity inverting means 410 inverts the intensity of the narrow band fluorescent image data NS' to 
obtain a reverse narrow band fluorescent image data NS", assigns an R color gradation to the reverse narrow band 

15 fluorescent image data NS", and then combines the reverse narrow band fluorescent image data NS" and the wide 
band fluorescence image data WS', to which a green color gradation has been assigned, to obtain a composite image 
data CS. 

[01 44] I n this manner, by inverting the intensity of the narrow band fluorescent image data NS', the difference between 
the normal tissue and the diseased tissue appearing in the composite image can be rendered more clearly, whereby 

20 the distinguishability of the tissue state of the target subject can be improved a level. 

[0145] Next, an endoscope implementing the fluorescence image obtaining apparatus according to the tenth em- 
bodiment of the present invention will be explained. According to the endoscope implementing the fluorescence image 
obtaining apparatus according to the tenth embodiment: the image computing unit 400 of the ninth embodiment inverts 
the intensity of the narrow band fluorescent image data NS', which has been multiplied by the gain rg, to obtain a 

25 reverse narrow band fluorescent image data NS"; then ? multiplies the reverse narrow band fluorescent image data NS" 
by a predetermined constant a (a > 1) to obtain a constant-multiplied reverse narrow band fluorescent image data 
NS"; and assigns a R color gradation to the constant-multiplied reverse narrow band fluorescent image data NS", which 
has been multiplied by the constant a has been multiplied. Therefore, as shown in Fig. 19, the image computing unit 
400 of the endoscope according to the tenth embodiment comprises a constant multiplying means 412, which is the 

30 same as that of the third embodiment. 

[0146] Hereinafter the operation of the tenth embodiment will be explained. Note that because the processes up until 
the multiplication of the fluorescent image data by the gain g are the same as those of the first embodiment, further 
explanation thereof has been omitted. According to the tenth embodiment: the gain rg is computed based on the 
reflectance image data RS; the narrow band fluorescent image data NS is multiplied by the gain rg to obtain a narrow 

35 band fluorescent image data NS', which has been multiplied by the gain rg; the narrow band fluorescent image data 
NS' is inputted to the intensity inverting mean 410; and the intensity inverting means 410 inverts the intensity of the 
narrow band fluorescent image data NS' to obtain a reverse narrow band fluorescent image data NS". Then, the reverse 
narrow band fluorescent image data NS" is inputted to the constant multiplying means 412. The constant multiplying 
means 412 multiplies the reverse narrow band fluorescent image data NS" by a predetermined constant a to obtain a 

40 constant-multiplied reverse narrow band fluorescent image data NS"; assigns an R color gradation to the reverse 
narrow band fluorescent image data NS"; and combines this colorized constant-multiplied reverse narrow band fluo- 
rescent image data NS" and the wide band fluorescence image data WS' to which a green color gradation has been 
assigned, to obtain a composite image data CS. 

[0147] In this manner by multiplying the reverse narrow band fluorescent image data NS" by a constant a, the effect 
45 wherein the dark portions appearing in the composite image also become red in color can be suppressed the same 
as in the third embodiment, preventing the misrecognition of portions that are simply dark and diseased tissue, and 
improving the distinguishability of the tissue state by a level. 

[0148] Note that according to the ninth an tenth embodiments, the intensity of the narrow band fluorescent image 
data NS* has been inverted; however, the intensity of the wide band fluorescent image data WS' may be inverted instead. 

50 [0149] Next, an endoscope implementing the fluorescence image obtaining apparatus according to the eleventh 
embodiment of the present invention will be explained. According to the endoscope implementing the fluorescence 
image obtaining apparatus according to the eleventh embodiment: the gain multiplying means 405 multiplies the narrow 
band fluorescent image data NS and the reflectance image data RS by the gain rg to obtain a narrow band fluorescent 
image data NS* and a reflectance image data RS'; computes the difference data between the narrow band fluorescent 

55 image data NS* and a reflectance image data RS'; then, multiplies the difference data by a predetermined constant a 
and assigns an R color gradation to the product obtained thereby. Therefore, as shown in Fig. 20, the image computing 
unit 400 of the endoscope according to the eleventh embodiment comprises a differenc data computing means for 
computing the difference data Ssub between the narrow band fluorescent image data NS', which has been multiplied 
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by the gain rg, and the reflectance image data RS' f which has been multiplied by the gain rg, and a constant multiplying 
means 412, which is the same as that of the third embodiment. 

[0150] The difference computing means 81 0 computes the difference between the values of the corresponding pixels 
of the reflectance image represented by the reflectance image data RS\ which has been multiplied by the gain rg ; and 
5 the fluorescent image represented by the narrow band fluorescent image data NS\ which has been multiplied by the 
gain rg, to obtain a difference data Ssub. 

[0151] Hereinafter the operation of the eleventh embodiment will be explained. Note that because the processes up 
until the multiplication of the fluorescent image data by the gain g are the same as those of the first embodiment, further 
explanation thereof has been omitted. According to the eleventh embodiment: the gain rg is computed based on the 

10 reflectance image data RS; the reflectance image represented by the reflectance image data RS is multiplied by the 
gain rg to obtain reflectance image data RS', the narrow band fluorescent image data NS is multiplied by the gain rg 
to obtain -narrow band fluorescent image data NS'; the reflectance image data RS' and narrow band fluorescent image — 
data NS' are inputted to the difference computing means 810; and the difference computing means 810 computes 
difference data Ssub. Further, the constant multiplying means 412 multiplies the difference data Ssub by the constant 

15 a to obtain an a Ssub, and assigns an R color gradation to thea Ssub. Next, the R colorized a Ssub and the wide band 
fluorescence image data WS', to which a green color gradation has been assigned, are combined to obtain a composite 
image data CS. 

[0152] In this manner, by computing the Ssub of the reflectance image represented by the reflectance image data 
RS\ which has been multiplied by the gain rg, and the narrow band fluorescent image data NS 1 , which has been 

20 multiplied by the gain rg,the difference between the diseased tissue and the normal tissue can be more clearly rendered. 
That is to say, by adjusting the luminosity of the fluorescence image, which is an effect of the intensity of the fluorescent 
light, to within a desired luminosity range, the distinguishability of the tissue state of the target subject can be improved. 
[0153] Next, an endoscope implementing the fluorescence image obtaining apparatus according to the twelfth em- 
bodiment of the present invention will be explained. According to the endoscope implementing the fluorescence image 

25 obtaining apparatus according to the twelfth embodiment: the narrow band fluorescent image data NS* and the wide 
band fluorescent image data WS', which have been multiplied by the gain rg, as in the eighth embodiment, are subjected 
to a dynamic range expansion process, based on the statistical quantity computed by the statistical quantity computing 
means 803, to obtain a wide band fluorescence image data DWS' and a narrow band fluorescent image data DNS'. 
Therefore, as shown in Fig. 20, the image computing unit 400 of the endoscope according to the twelfth embodiment 

30 is provided with a dynamic range expanding means 814, which is the same as that of the fourth embodiment. 

[01 54] As shown in the formula (8) below, the dynamic range expanding means 81 4 computes, based on the average 
value m and the standard deviation q of each pixel of the reflectance image computed by the statistical quantity com- 
puting means 803, the distribution range of the pixel values of each fluorescence image represented by the wide band 
fluorescence image data DWS' and the narrow band fluorescent image data DNS*, which have been subjected to the 

35 dynamic range expansion process. Note that in the Formula (8), b = 2, for example. 

Distribution range = rm - b x ro to rm + b x ra (8) 

40 [0155] Then, if the minimum value (Min) is designated as rm - bx ro, the maximum value (Max) as rm + bx ro, each 
pixel value of each fluorescent image that has been subjected to the dynamic range expansion process can be com- 
puted by use of the function rg (x) (where x equals the pixel values of the narrow band fluorescent image and the wide 
band fluorescent image which have been multiplied by the gain rg) shown in the Formula (9) below. 

rg (x) = (x - Min) / (Max - Min) (9) 

[0156] Hereinafter the operation of the twelfth embodiment will be explained. Note that because the processes up 
until the multiplication of the fluorescent image data by the gain g are the same as those of the first embodiment, further 

so explanation thereof has been omitted. According to the twelfth embodiment: the gain g is computed based on the 
reflectance image data RS; the narrow band fluorescent image data NS and the wide band fluorescence image data 
WS are multiplied by the gain g to obtain a narrow band fluorescent image data NS' and a wide band fluorescence 
image * data WS'; the narrow band fluorescent image data NS 1 and the wide band fluorescence image data WS' are 
inputted to the dynamic range expanding means 814, and are subjected to the dynamic range expansion process 

55 therein to obtain a the wide band fluorescence image data DWS' and a narrow band fluorescent image data DNS'. The 
wide band fluorescence image data DWS* and the narrow band fluorescent image data DNS' are assigned an R color 
gradation and a G color gradation, respectively, and are then combined to obtain a composite image dataCS. 
[0157] In this manner by expanding the dynamic range of the narrow band fluorescent image data NS' and the wide 
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band fluorescent image data WS\ because the contrast of the composite image formed thereof can be made higher, 
the change in the tissue state of the target subject 50 can be represented more accurately in the composite image, 
whereby the distinguishability of the tissue state of the target subject 50 can be further improved. 
[0158] Note that for cases in which the statistical quantity computing means 803 computes the Max and Min values 
5 of each pixel of the reflectance image, the dynamic range expanding means 814 can compute the distribution range 
of the pixel values of each respective dynamic-range expanded fluorescent image represented by the wide band flu- 
orescence image data DWS* and the narrow band fluorescent image data DNS\ by use of the Formula (10) below. 
Note that in Formula (1 0), c and d are arbitrary constants. 

10 

Distribution range = (rMax + rMin) / 2 - c X (rMax - rMin) 12 

to (rMax + rMin) / 2 + d X (rMax - rMin)/2 (10) 

15 [0159] Note that according to the twelfth embodiment, the dynamic expansion process can be preset so as to be 
performed for each image, or can be performed only when so desired by the operator of the endoscope, by use of a 
foot switch 210 or a hand operated switch 212, in the same manner as in the fourth embodiment. 
[0160] Further, according to the twelfth embodiment described above, the dynamic range expanding means 814 of 
the eighth embodiment has been provided, and the dynamic range process performed; however, it is also possible to 

20 perform the same dynamic range process in the ninth through the eleventh embodiments. In this case, according to 
the ninth embodiment, the dynamic range expansion process can be performed on the reverse narrow band fluorescent 
image data NS"; in the tenth embodiment, the dynamic range expansion process can be performed on the constant- 
multiplied reverse narrow band fluorescent image data NS". Further, according to the eleventh embodiment, the dy- 
namic range expansion process can be performed on the constant-multiplied difference data a Ssub. 

25 [0161] Note that according to the eighth through the twelfth embodiments described above, a G color gradation has 
been assigned to the wide band fluorescence image data WS' (included those of which the dynamic range has been 
expanded) and an R color gradation has been assigned to the narrow band fluorescent image data NS' (included those 
of which the dynamic range has been expanded, those of which the intensity thereof has been inverted, and those that 
have been multiplied by the constant a)or to the constant-multiplied difference data a Ssub; however, an R color 

30 gradation can be assigned to the wide band fluorescence image data WS', and a G color gradation can be assigned 
to the,narrow band fluorescent image data NS 1 or the constant-multiplied difference data a Ssub. Further, in addition 
to the G and R color gradations, a B color gradation may be assigned as well. In this case, a G and a B color gradation 
can be assigned to the wide band fluorescence image data WS', and an R color gradation can be assigned to the 
narrow band fluorescent image data NS' or the constant-multiplied difference data a Ssub; alternatively, a G and a B 

35 color gradation can be assigned to the narrow band fluorescence image data NS' or the constant-multiplied difference 
data a Ssub, and an R color gradation can be assigned to the wide band fluorescent image data WS'. Note that the 
change in the assignment of the color gradations can be performed after the fluorescent images and the constant- 
multiplied difference data a Ssub have been ^subjected to the dynamic range expansion process, the of the constant 
a multiplication process, or the intensity inversion process. 

40 [0162] Next, an endoscope implementing the fluorescence image obtaining apparatus according to the thirteenth 
embodiment of the present invention will be explained. According to the endoscope implementing the fluorescence 
image obtaining apparatus according to the thirteenth embodiment: a hue image data H is obtained of the narrow band 
fluorescent image data NS' and the wide band fluorescent image data WS', which have been multiplied by the gain rg, 
as in the eighth embodiment, a luminosity image data V is obtained of the wide band fluorescent image data WS\ and 

45 the hue image data H and the luminosity image data V are combined to obtain a composite image data. Therefore, as 
shown in Fig. 22, the image computing unit 400 of the endoscope according to the thirteenth embodiment comprises, 
in a configuration similar to that of the fifth embodiment: a hue image data forming means 420. instead of a hue gradation 
assigning means 406, a hue gradation assigning means 407 and an image composing means 408, for forming a hue 
data H, which represents a hue, from the narrow band fluorescent image data NS' and the wide band fluorescent image 

50 data WS*, which have been multiplied by the gain rg; a luminosity image data forming means 422 for forming, based 
on the wide band fluorescent image data WS', a luminosity image data V representing a brightness; and an image 
composing means 424 for combining the hue data H and the luminosity image data V to obtain a composite image 
data CS\ 

[0163] Hereinafter the operation of the thirteenth embodiment will be explained. Note that because the processes 
55 up until the multiplication of the fluorescent image data by the gain g are the same as those of the eighth embodiment, 
further explanation thereof has been omitted. According to the thirteenth embodiment: the narrow band fluorescent 
image data NS' and the wide band fluorescence image data WS*, which have been multiplied by the gain rg formed 
based on the reflectance image data RS, are inputted to the hue image data forming means 420. The hue image data 
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forming means 420 outputs the wide band fluorescent image data WS' and the narrow band fluorescent image data 
NS' to respectively different color pianes (e.g., G and R), and forms, based on the additive color mixture method, a 
color added and mixed image data representing a color added and mixed image ; then, by computing, based on this 
color added and mixed image data, the hue value of the color added and mixed image represented by said color added 
5 and mixed image data and occurring in the Munsell color system, the hue image data forming means 420 forms a hue 
data value H. 

[0164] On the other hand, the wide band fluorescent image data WS 1 , which has been multiplied by the gain rg, is 
inputted to the luminosity image data forming means 422; then, the luminosity image data forming means forms, based 
on the range of the pixel values of the wide band fluorescent image represented by the wide band fluorescent image 
10 data WS 1 and the look-up table, a luminosity image data V determining a luminosity V (Value) occurring in the Munsell 
color system. 

[0165] The hue image data H and the luminosity image data V are inputted to the image composing means 424, and 
the image composing means 424 forms a composite image data CS\ In this case, because a saturation is required in 
addition to the hue and luminosity, when the composite image CS' is to be composed, the largest value of each hue 
is and each luminosity is set as a saturation value S occurring in the Munsell color system, and the composite image 
data CS' is formed by performing an RGB conversion process. In this manner, data relating to the tissue state of the 
target subject 50 as well as data relating to the form of the target subject 50 can be displayed concurrently in a single 
image, the same as in the fifth embodiment. 

[0166] Next, an endoscope implementing the fluorescence image obtaining apparatus according to the fourteenth 

20 embodiment of the present invention will be explained. According to the endoscope implementing the fluorescence 
image obtaining apparatus according to the fourteenth embodiment: the narrow band fluorescent image data NS' and 
the wide band fluorescent image data WS', which have been multiplied by the gain rg formed based on the reflectance 
image data RS, as in the thirteenth embodiment, are subjected to a dynamic range expansion process, based on the 
statistical quantity computed by the statistical quantity computing means 803. Therefore, as shown in Fig. 23, the image 

25 computing unit 400 of the endoscope according to the fourteenth embodiment is provided with a dynamic range ex- 
panding means 826 for subjecting the wide band fluorescent image data WS', which has been multiplied by said gain 
rg, to a dynamic range expansion process. Note that because the dynamic range expanding means 826 performs the 
same process as that performed by the dynamic range expanding means 414 of the fourth embodiment, a detailed 
explanation thereof has been omitted. 

30 [0167] In this manner, by providing the dynamic range expanding means 826, because the distribution of the lumi- 
nosity image data V can be made to span substantially the entire area of the display gradation curve of the composite 
image monitor 602, the contrast of the composite image formed thereof can be made higher. Accordingly, the change 
in the tissue state of the target subject 50 can be represented more accurately in the composite image, whereby the 
distinguishability of the tissue state of the target subject 50 can be further improved. 

35 [0168] Note that according to the fourteenth embodiment, the dynamic expansion process can be preset so as to be 
performed for each image, or can be performed only when so desired by the operator of the endoscope, by use of a 
foot switch 210 or a hand operated switch 212, in the same manner as occurred in the fourth embodiment. 
[0169] Further, according to the above-described thirteenth and fourteenth embodiments, although hue image data 
H and luminosity image data V have been formed in addition to the processes performed in the eighth embodiment, it 
is also possible that a hue image data H and luminosity image data V be formed and combined to obtain a composite 
image data CS' in addition to the processes performed in the ninth through twelfth embodiments described above. In 
this case, according to the ninth embodiment, the hue image data H can be formed utilizing the reverse narrow band 
fluorescence image NS"; according to the tenth embodiment, the hue image data H can be formed utilizing the constant- 
multiplied reverse narrow band fluorescence image NS". Further, according to the eleventh embodiment, the hue image 

^5 data H can be formed utilizing the difference data a Ssub, which has been multiplied by the constant a; and according 
to the twelfth embodiment, the hue image data H can be formed utilizing the wide band fluorescence image DWS' and 
the narrow band fluorescence image DNS', which have been subjected to a dynamic range expansion process. 
[01 70] Still further, according to the above-described thirteenth and fourteenth embodiments, although the luminosity 
image data V has been formed, based on the wide band fluorescent image data WS', which has been multiplied by 

50 the gain rg, by the luminosity image data forming means 422, the luminosity imac/e data V may also be formed based 
on the narrow band fluorescent image data NS", which has been multiplied by the gain rg. 

[0171] In addition, according to the above-described thirteenth and fourteenth embodiments, the luminosity image 
data V has been formed, based on the wide band fluorescent image data WS', which has been multiplied by the gain 
rg, by the luminosity image data forming means 422; however, according to the fifteenth embodiment shown in Fig. 
55 24, the reflectance image data RS 1 may also be multiplied by the gain rg, by the gain multiplying means 405, to obtain 
a reflectance image data RS', which has been multiplied by the gain rg, and the luminosity image data V may also be 
formed based on this reflectance image data RS', which has been multiplied by the gain rg. 

[0172] Additionally, according to the above-described thirteenth and fourteenth embodiments, the luminosity image 
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data V has been formed, based on the wide band fluorescent image data WS', which has been multiplied by the gain 
rg, by the luminosity image data forming means 422; however, according to the sixteenth embodiment shown in Fig. 
25, the luminosity image data V may also be formed based on the wide band fluorescent image data WS, which has 
not yet been multiplied by the gain rg. Note that needless to say, the luminosity image data V can also be formed based 
s on the narrow band fluorescent image data NS or the reflectance image data RS, which has not yet been multiplied 
by the gain rg. In this case, it is preferable that it be possible to switch the image data, based upon which the luminosity 
image data is to be formed, between that which has not yet been multiplied by the gain rg and that which has been 
multiplied by the gain rg. 

[01 73] Note that for cases in which the luminosity image data V has been formed, based on the wide band fluorescent 
10 image data WS', which has been multiplied by the gain rg, because the gain changes by a large amount if the distance 
between the target subject 50 and the distal end of the endoscope insertion portion 1 00 changes a large amount, the 
brightness of the displayed composite image is also changed by a large amount. Therefore, by forming the tuminosity 
image data V based on the wide band fluorescent image data WS, which has not yet been multiplied by the gain rg, a 
large change in the brightness of the composite image can be prevented. 
*5 [0174] Note that according to the thirteenth through the sixteenth embodiments, although the hue image H (a uniform 
saturation) has been computed, these embodiments are not limited thereto: an image corresponding to the the X,Y 
components of an XYZ color space; the ab components of a Lab color space; the uv components of a Luv color space; 
the a*b* components of a uniform La*b* color space; the u*v* components of a uniform Lu*v* color space; etc. ; can 
also be computed. 

20 [0175] Further, according to the first through the sixteenth embodiments described above, the statistical quantity 
computed by the statistical quantity computing means 403, 803 can be computed based on fluorescent image or the 
reflectance image obtained in the frame preceding the frame in real time frame, instead of a single frame in real time 
frame of the fluorescent image or the reflectance image. 

[0176] Still further, according to the first through the sixteenth embodiments, a standard image obtaining element 
25 107 has been disposed in the distal end of the endoscope insertion portion 100; however, by utilizing an image fiber, 
the standard image obtaining element 1 07 can be disposed within the interior of the image data processing portion of 
the endoscope. Further the standard image fiber, the fluorescent image fiber and the image obtaining element can be 
provided in the form of a common unit. In this case, the optical transmitting filter can be provided with a filter for obtaining 
standard images. Still further, by providing the image obtaining element with an on-chip mosaic filter that has a func- 
30 tionality equivalent to that of the filter for obtaining standard images with which the optical transmitting filter has been 
provided, the standard image obtaining element and the fluorescent image obtaining element can be provided in the 
distal end portion of the endoscope insertion portion. 

[0177] In addition, according to the composite image display method, a standard image display monitor 601 and a 
composite image display monitor 602 have been provided separately; however, both said types of images can be 
35 displayed on a single monitor. In this case, the switching between the display of the standard image and the composite 
image can be automatically controlled in a temporal series manner by the control computer, by use of an appropriate 
switching means to be operated by the operator, or by a desired switching configuration. Further, the standard image 
and the composite image may be superposed and displayed. 

[0178] Additionally, the image fiber 103 can be provided as a composite glass fiber instead of a quartz glass fiber. 

40 In this case, because a composite glass fiber emits fluorescent light when an excitation light enters therein, an excitation 
light cutoff filter 302 must be provided between the focusing lens 106 and the fluorescent light entry end of the image 
fiber 103. By using a composite glass fiber instead of a quartz glass fiber, the cost can be reduced. 
[0179] Note that according to the first through the sixteenth embodiments, the computational process of the image 
computing unit 400 are not limited to being performed on each pixel unit; the processes can be performed on the pixel 

45 units corresponding to the binning process of the high sensitivity fluorescence image obtaining element, or on an 
arbitrary vertical by horizontal (n X m) block of pixels selected by the operator. 

[0180] Further, any light source that emits light having a wavelength in the 400-420 nm wavelength band can be 
selected as the excitation light source. 

[0181] Still further, according to the first through the sixteenth embodiments, the excitation light source and the white 
so |jght source have been provided separately; however, by employing an appropriate optical filter, a common light source 
can be employed. 

Claims 

55 

1 . A fluorescence image display apparatus comprising: 

a fluorescence image obtaining means for irradiating a target subject with an excitation light and obtaining two 
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fluorescence image data, each formed of fluorescent light of a mutually different wavelength band, based on 
the fluorescent light intensity emitted from the target subject upon the irradiation thereof by the excitation light, 
a gain computing means for computing, based on the statistical quantity of either one of said two fluorescence 
image data, a gain that said two fluorescence image data are to be multiplied by, 
5 a multiplying means for multiplying said two fluorescence image data by said gain and obtaining two multiplied 

fluorescence image data, 

an image forming means for forming, based on said two multiplied fluorescence image data, a pseudo color 
image data representing a pseudo color image reflecting the tissue state of the target subject, and 
an image display means for displaying said pseudo color image. 

10 

2. A fluorescence image display apparatus as defined in claim 1 , wherein 

said image forming means is a means for forming the pseudo color image, based on an additive color mixture 
method, from both of the multiplied fluorescence image data. 

15 3. a fluorescence image display apparatus as defined in claim 1 , wherein the image forming means comprises: 

a color image forming means for forming a color added and mixed image data, based on an additive color 
mixture method, from both of the multiplied fluorescence image data, and a color image data, based on said 
color added and mixed image data, representing the chromatic components of the color added and mixed 
20 image represented by said color added and mixed image data, 

a luminosity image forming means for forming a luminosity image data representing a luminosity image by 
assigning a luminosity display gradation to the pixel values of the multiplied fluorescence image represented 
by either of the two multiplied fluorescence image data, 

and a composite image forming means for combining the color image data and the luminosity image data to 
25 form a pseudo color image data. 

4. A fluorescence image display apparatus as defined in claim 1 . further comprising 

a dynamic range expanding means for expanding, based on the statistical quantity, the dynamic range of 
both of the multiplied fluorescence image data so that the dynamic range of each said image data spans substan- 
ce tially the entirety dynamic range of the display means. 

5. A fluorescence image obtaining apparatus as defined in any of the claims 1,2,3, or 4, wherein 

a portion or the entirety of the illuminating means, the image obtaining means, and the readout means is 
provided in the form of an endoscope provided with an insertion portion to be inserted into a body cavity of a patient. 

35 

6. A fluorescence image display apparatus comprising: 

a fluorescence image obtaining means, for irradiating a target subject with an excitation light and obtaining two 
fluorescence image data, each formed of fluorescent light of a mutually different wavelength band, based on 
40 the fluorescent light intensity emitted from the target subject upon the irradiation thereof by the excitation light, 

a reflectance image obtaining means for irradiating a target subject with a reference light and obtaining a 
reflectance image data, based on the intensity of the reference light reflected from the target subject upon the 
irradiation thereof by the reference light, 

a gain computing means for computing, based on the statistical quantity of said reflectance image data, a gain 
45 that said two fluorescence image data are to be multiplied by, 

a multiplying means for multiplying said two fluorescence image data by said gain to obtain two multiplied 
fluorescence image data, 

an image forming means for forming, based on said two multiplied fluorescence image data, a pseudo color 
image data representing a pseudo color image reflecting the tissue state of the target subject, and 
so an image display means for displaying said pseudo color image. 

7. A fluorescence image display apparatus as defined in claim 6 : wherein 

said image forming means can also be a means for forming the pseudo color image, based on an additive 
color mixture method, from both of the multiplied fluorescence image data. 

55 

8. A fluorescence image display apparatus as defined in claim 6 : wherein the image forming means comprises: 

a color image forming means for forming a color added and mixed image data, based on an additive color 
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mixture method, from both of the multiplied fluorescence image data, and a color image data, based on said 
color added and mixed image data, representing the chromatic components of the color added and mixed 
image represented by said color added and mixed image data, 

a luminosity image forming means for obtaining a multiplied reflectance image data by multiplying the reflect- 
ance image data by said gain : and forming a luminosity image data representing a luminosity image by as- 
signing a luminosity display gradation to the pixel values of the multiplied reflectance image or the pixel values 
of the multiplied fluorescence image represented by either of the two multiplied fluorescence image data : and 
a composite image forming means for combining the color image data and the luminosity image data to form 
a pseudo color image data. 

9. A fluorescence image display apparatus comprising: 



a fluorescence image obtaining means for irradiating a target subject with an excitation light and obtaining two 
fluorescence image data, each formed of fluorescent light of a mutually different wavelength band, based on 
15 the fluorescent light intensity emitted from the target subject upon the irradiation thereof by the excitation light, 

a reflectance image obtaining means for irradiating a target subject with a reference light and obtaining a 
reflectance image data, based on the intensity of the reference light reflected from the target subject upon the 
irradiation thereof by the reference light, 

a gain computing means for computing, based on the statistical quantity of said reflectance image data, a gain 
20 that said two fluorescence image data are to be multiplied by, 

a multiplying means for multiplying said two fluorescence image data and the reflectance image data by said 

gain to obtain two multiplied fluorescence image data and a multiplied reflectance data, 

a difference computing means for computing the difference data between the multiplied reflectance image 

data and either of the two multiplied fluorescence image data, 
^5 an image forming means for forming, based on said difference data and the multiplied fluorescence image 

data that was not used in the computation of said difference data, a pseudo color image data representing a 

pseudo color image reflecting the tissue state of the target subject, and 

an image display means for displaying said pseudo color image. 

30 10. A fluorescence image display apparatus as defined in claim 9, wherein 

said image forming means can also be a means for forming the pseudo color image, based on an additive 
color mixture method, from both of the multiplied fluorescence image data. 



11. A fluorescence image display apparatus as defined in claim 9 : wherein the image forming means comprises: 



a color image forming means for forming a color added and mixed image data, based on an additive color 
mixture method, from the difference data and the multiplied fluorescence image data, and a color image data, 
based on said color added and mixect image data, representing the chromatic components of the color added 
and mixed image represented by said color added and mixed image data, 
40 a luminosity image forming means for assigning a luminosity display gradation to the pixel values of the mul- 

tiplied reflectance image represented by the multiplied reflectance image data or the pixel values of the mul- 
tiplied fluorescence image represented by either of the two multiplied fluorescence image data to form a lu- 
minosity image data representing a luminosity image, and 

a composite image forming means for combining the color image data and the luminosity image data to form 
45 a pseudo color image data. 

12. A fluorescence image display apparatus as defined in any of the claim 6, 7, 8, 9, 10, or 11, further comprising 

a dynamic range expanding means for expanding, based on the statistical quantity, the dynamic range of 
the reflectance image data and/or both of the multiplied fluorescence image data so that the dynamic range thereof 
so spans substantially the entirety of the dynamic range of the display means. ' 

13. A fluorescence image obtaining apparatus as defined in any of the claims 6, 7, 8, 9, 10, or 11 , wherein 

a portion or the entirety of the illuminating means, the image obtaining means, and the readout means is 
provided in the form of an endoscope provided with an insertion portion to be inserted into a body cavity of a patient. 



14. A fluorescence image obtaining apparatus as defined in claim 12, wherein 

a portion or the entirety of the illuminating means, the image obtaining means, and the readout means is 
provided in the form of an endoscope provided with an insertion portion to be inserted into a body cavity of a patient. 
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15. A fluorescence image display apparatus as defined in any of the claims 6, 7, 8, 9, 10, or 11 , wherein 

said image forming means is a means for obtaining a reverse fluorescence image data by inverting the light 
intensity of either of the multiplied fluorescence image data, and 
5 forming a pseudo color image based on this reverse fluorescence image data and the other multiplied fluo- 

rescence image data of the two multiplied fluorescence image data. 

16. A fluorescence image display apparatus as defined in claim 12, wherein 

10 said image forming means is a means for obtaining a reverse fluorescence image data by inverting the light 

intensity of either of the multiplied fluorescence image data, and 

forming a pseudo color image based on this reverse fluorescence image data and the other multiplied fluo- 
rescence image data of the two multiplied fluorescence image data. 

is 17. A fluorescence image display apparatus as defined in claim 13, wherein 

said image forming means is a means for obtaining a reverse fluorescence image data by inverting the light 
intensity of either of the multiplied fluorescence image data, and 

forming a pseudo color image based on this reverse fluorescence image data and the other multiplied fluo- 
20 rescence image data of the two multiplied fluorescence image data. 
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(54) Fluorescence image display apparatus 



(57) A fluorescence image display apparatus is pro- 
vided; wherein, when a pseudo color image represent- 
ing the tissue state of a target subject is obtained, based 
on a fluorescence image emitted from the target subject 
upon the irradiation thereof by an excitation light, the 
tissue state can be recognized regardless of the inten- 
sity of the fluorescent light. Based upon the statistical 
quantity of a wide band fluorescence image computed 
by a statistical quantity computing means, a .gain that 
the wide band and narrow band fluorescence image da- 



ta are to be multiplied by is computed by a gain comput- 
ing means. A gain multiplying means multiplies the wide 
band and narrow band fluorescence image data by the 
gain, whereby a green gradation is assigned to the wide 
band fluorescence image and a red gradation is as- 
signed to the narrow band fluorescence image, and a 
composite image data is obtained by an image compos- 
ing means. 
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